-- Logs begin at Tue 2022-05-17 11:25:33 UTC, end at Tue 2022-05-17 12:33:39 UTC. -- May 17 11:51:39.541522 dv-cinder-837699-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 17 11:51:39.549581 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 17 11:51:39.551571 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 11:51:39 2022] *** May 17 11:51:39.551571 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 11:51:39.551571 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 11:51:39.551571 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: nodename: dv-cinder-837699-7-iscsi May 17 11:51:39.551571 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: machine: x86_64 May 17 11:51:39.551571 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: clock source: unix May 17 11:51:39.551571 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: pcre jit disabled May 17 11:51:39.551963 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: detected number of CPU cores: 4 May 17 11:51:39.551963 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: current working directory: / May 17 11:51:39.551963 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: detected binary path: /usr/bin/uwsgi-core May 17 11:51:39.551963 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: your processes number limit is 47680 May 17 11:51:39.551963 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: your memory page size is 4096 bytes May 17 11:51:39.551963 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: detected max file descriptor number: 2048 May 17 11:51:39.551963 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: lock engine: pthread robust mutexes May 17 11:51:39.551963 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: thunder lock: enabled May 17 11:51:39.551963 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 17 11:51:39.552437 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 11:51:39.598738 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: Python main interpreter initialized at 0x55dde16ee9c0 May 17 11:51:39.598738 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: python threads support enabled May 17 11:51:39.598738 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: your server socket listen backlog is limited to 100 connections May 17 11:51:39.598738 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: your mercy for graceful operations on workers is 90 seconds May 17 11:51:39.599128 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: mapped 403077 bytes (393 KB) for 2 cores May 17 11:51:39.599203 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: *** Operational MODE: preforking *** May 17 11:51:39.599483 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: *** uWSGI is running in multiple interpreter mode *** May 17 11:51:39.599483 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: spawned uWSGI master process (pid: 79855) May 17 11:51:39.599688 dv-cinder-837699-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 17 11:51:39.604206 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: spawned uWSGI worker 1 (pid: 79870, cores: 1) May 17 11:51:39.604206 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: spawned uWSGI worker 2 (pid: 79871, cores: 1) May 17 11:51:39.604206 dv-cinder-837699-7-iscsi devstack@keystone.service[79855]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 11:51:45.343298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 11:51:45.343298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: from cryptography.utils import int_from_bytes May 17 11:51:45.344061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 11:51:45.344061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: from cryptography.utils import int_from_bytes May 17 11:51:45.344653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 11:51:45.344653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: from cryptography.utils import int_from_bytes May 17 11:51:45.345410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 11:51:45.345410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: from cryptography.utils import int_from_bytes May 17 11:51:45.393719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 11:51:45.394001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 11:51:45.394086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] command line args: [] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 11:51:45.394248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 11:51:45.394339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 11:51:45.394407 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 11:51:45.394552 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ================================================================================ {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 11:51:45.394630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] command line args: [] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 11:51:45.394756 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] admin_token = **** {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.394832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 11:51:45.394998 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] config_dir = [] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.395080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ================================================================================ {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 11:51:45.395228 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.395316 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] admin_token = **** {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.395382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] config_source = [] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.395518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] config_dir = [] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.395606 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] debug = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.395673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.395737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.398165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] config_source = [] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.398165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] debug = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.398595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.398789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.399048 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.399246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.399416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.399649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.399823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.400021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.400254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] list_limit = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.400481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.400684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] log_config_append = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.400684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.401028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] list_limit = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.401216 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] log_dir = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.401422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] log_config_append = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.401614 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] log_file = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.401839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.401839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] log_dir = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.402182 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.402370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] log_file = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.402565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.402762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.402933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.403071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.403234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.403372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.403530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.403530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.403802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.403802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.404064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.404239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.404374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.404512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.404650 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.404785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.404918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.405045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.405171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.405318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.405446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.405610 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.405747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.405891 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.406033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.406169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.406302 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.406440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.406440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.406686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.406686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] publish_errors = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.406934 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.407072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.407712 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] publish_errors = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.407920 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.407920 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.408423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.408423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.408676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.408813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.408997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.409136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.409264 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] standard_threads = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.409390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.409525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.409670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] standard_threads = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.409798 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.409798 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.410036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.410163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] use_journal = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.410300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.410433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] use_json = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.410565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.410697 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] use_stderr = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.410830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] use_journal = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.410956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] use_syslog = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.411091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] use_json = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.411218 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.411344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] use_stderr = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.411344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] use_syslog = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.411591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.411716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:51:45.411854 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.411987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.412115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.414136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.414280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.414411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.414552 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.414681 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.414808 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.414934 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.415059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.415276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.415414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.415542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.415669 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.415794 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.415926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.416061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.416256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.416409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.416599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.416809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.417030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.417030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.417352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.417612 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.417800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.417967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.418098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.418234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.418369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.418498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.418655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.418848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.418980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.419138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.419286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.419432 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.419562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.419689 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.419815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.419950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.420078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.420234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.420378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.420507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.420634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.420769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.420897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.421022 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.421154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.421292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.421418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.421563 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.421696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.421824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.421956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.422082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.422213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.422418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.422547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.422675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.422801 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.423515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.423665 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.423802 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.423935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.424062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.424239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.424374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.424510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.424645 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.424774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.424900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.425026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.425151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.425277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.425411 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.425549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.425675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.425802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.425927 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.426061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.426189 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.426314 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.426439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.426576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.426707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.426844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.426971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.427097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.428411 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.428591 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.428786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.429025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.429190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.429384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.429575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.429772 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.429772 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.430146 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.430336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.430597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.430803 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.430968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.431174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.431405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.431570 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.431762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.431952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.432143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.432358 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.432589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.432754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.432951 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.433150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.433347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.433509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.433691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.433864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.434003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.434437 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.434573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.434710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.434839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.434972 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.435137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.435284 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.435419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.435547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.435674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.435816 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.435952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.436082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.436246 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.436382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.436551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.436689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.436689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.436941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.436941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.437185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.437314 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.437440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.437578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.437716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.437844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.437971 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.438098 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.438225 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.438361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.438490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.438490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.438740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.438868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.438995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.439258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.439396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.439525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.439662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.439790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.439923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.440059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.440217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.440361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.440491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.440618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.440745 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.440881 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.441011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.441138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.441266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.441402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.441540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.441669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.441796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.441923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.442050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.442182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.442321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.442460 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.442601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.442730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.442858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.442985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.443112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.443248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.443388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.443552 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.443687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.443814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.443942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.444068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.444270 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.444407 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.444535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.444672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.444800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.444933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.445069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.445208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.445335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.445462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.445589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.445718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.445853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.445982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.446109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] auth.external = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.446236 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] auth.external = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.446362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.446495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.446634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.446793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.446951 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.447082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.447210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] auth.password = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.447210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] auth.token = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.447451 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] auth.password = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.447578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.447714 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] auth.token = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.447852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.447981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.448109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.448256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.448387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.448526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.448656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.448796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.448925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.449057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.449194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.449322 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.449450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] credential.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.449577 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.449704 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.449838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] credential.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.449975 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.450105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.450233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.450360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.450497 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.450625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.450764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.450894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.451023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.451150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.451277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.451405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.451540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.451669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.451797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.451925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.452052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.452206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.452206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.452478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.452478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.452717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.452845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.452973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.453110 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.453246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.453375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.453502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.453630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] federation.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.453758 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.453894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.454073 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] federation.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.454213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.454341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.454475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.454611 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.454815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.454947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.455080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.455212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.455339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.455466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.455602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.455739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.455868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.456006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.456300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.456479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.456628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.456759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.456887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.457014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.457142 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.457271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.457407 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.457537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.457665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.457794 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.457936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.458066 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.458206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.458337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.458465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.458592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.458720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.458847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.458984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.459113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.459241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.459370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.459497 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.459625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.459771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.459901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.460029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.460163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.460337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.460467 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.460607 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.460737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.460865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.460993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.461270 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.461441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.461577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.461717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.461847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.461976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.462105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.462241 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.462371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.462500 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.462629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.462756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.462884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.463020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.463149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.463278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.463406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.463545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.463674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.463810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.463939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.464068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.464258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.464395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.464524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.464665 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.464800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.464929 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.465057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.465185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.465312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.465458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.465588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.465717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.465844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.465972 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.466100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.466236 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.466366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.466501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.466634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.466762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.466890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.467025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.467164 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.467302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.467437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.467566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.467695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.467831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.467961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.468088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.468243 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.468378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.468506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.468645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.468776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.468905 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.469043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.469171 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.469299 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.469436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.469565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.470216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.470412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.470546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.470677 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.470814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.470946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.471074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.471202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.471330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.471467 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.471604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.471733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.471861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.471996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.472125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.472293 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.472434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.472564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.472692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.472820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.472949 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.473076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.473076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.473466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.473593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.473721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.473848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.473985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.474115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.474244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.474371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.474371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.474621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.474750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.474877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.475015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.475143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.475271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.475412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.475541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.475674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.475802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.475930 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.476058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.476244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.476382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.476520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.476650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.476788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.476916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.477055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.477185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.477312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.477439 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.477567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.477694 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.477829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.477958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.478085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.478303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.478439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.478568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.478715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.478845 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.478973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.479101 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.479230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.479357 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.479494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.479624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.479756 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.479884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.480011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.480138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.480319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.480450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.480588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.480717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.480844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.480972 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.481177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.481308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.481437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] resource.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.481564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.481692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.481820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] resource.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.481972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.482232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.482385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.482518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.482656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.482785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.482921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.483051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.483180 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.483307 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.483436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.483564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.483700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.483836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.483970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.484105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.484311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] role.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.484454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.484596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] role.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.484726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] role.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.484866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.485037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] role.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.485170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.485305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.486094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.486239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.486412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.486588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.486729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.486865 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.487009 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.487157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.487292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.487427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.487562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.487698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.487841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.487977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.488112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.488285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.488422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.488558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.488706 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.488843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.488988 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.489124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.489259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.489403 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.489540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.489674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.489809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.489943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.490077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.490220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.490356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.490491 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.490626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.490771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.490906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.490906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.491171 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.491305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.491439 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.491439 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.491693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.491693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.491958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.492092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.492287 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.492430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.492575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.492723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.492861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.492995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.493129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.493264 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.493398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.493541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.493677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.493812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.493948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.494081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.494215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.494357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.494504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.494639 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] token.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.494773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.494914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.495051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.495194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.495330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] token.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.495465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.495598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.495733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.495867 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.496011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.496148 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.496324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.496461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.496602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.496751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.496887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.497022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.497158 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.497292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.497427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.497570 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.497712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.497848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.497982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.498118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.498262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.498406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.498543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.498678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.498812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.498947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.499081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.499224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.499361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.499496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.499630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.connection = **** {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.499774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.499918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.500055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.500243 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.500397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.connection = **** {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.500543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.500688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.500831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.501005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.501145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.501282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.501427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.501565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.501701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.501837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.501979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.502117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.502270 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.502409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.502545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.502680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.502816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.502951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.503094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.503231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.503367 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.503503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.503638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.503773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.503986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.504138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.504306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.504444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.504590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.504726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.504869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.504869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 11:51:45.505128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.505128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.505128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:51:45.505128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 11:51:45.510901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.511138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.511367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.511523 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.511662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.511903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.520174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.520596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.549890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.550159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.550319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.550467 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.603143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.603446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.655391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.655627 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.664658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.664998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.723398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.723674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.723857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.724049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.724290 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.724450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.724536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.724723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.724908 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.725131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.725349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.725562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.747640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.747768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.747956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.748039 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.748101 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.748337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.748436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.748501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.748561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.748801 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.748881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.748953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.749015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.749075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.760261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.760535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.775331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.775581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.775668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.775837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.775917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.775980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.776058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.776331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.776416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.776478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.776537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.776610 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79871) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.776674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.776994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 11:51:45.794338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.794551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 11:51:45.794825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.794914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.795080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 11:51:45.795163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 11:51:45.795340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.795420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.795594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 11:51:45.795673 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.795838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.795917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.796081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.796161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.796418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.796557 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.807128 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.807405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.807673 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.807830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.807969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.808107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.808279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.808520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.816321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.816882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.819573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.819851 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.820128 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.820311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.820451 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.820587 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.820725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.820862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.821048 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.821202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.821341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.821478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.821625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.821762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.821907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.822046 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.822185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.822320 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.822320 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.822586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.822586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.822847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.849383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.850140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.851003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.851280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.851766 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.852056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.856651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.856881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.857159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.857393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.857671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.857949 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.864989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.865267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.865988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.866271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.869854 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.870138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.870417 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.870694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.870921 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.871068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.871217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.871355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.871513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.871650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.871787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.871924 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.872060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.872269 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.872538 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.872805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.890887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.891158 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.891907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.892441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.895668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.896689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.899271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.899564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.900306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.900602 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.904498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.905548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.908138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.909242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.911829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.912121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.912426 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.912708 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.912950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.913036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.913240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.913327 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.913515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.913799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.914072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.914345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.932775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.933152 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.933421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.933684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.933770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.934137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.934673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.934938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.942397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.943518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.944101 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.944405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.945250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.945527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.947421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.947707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.947983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.948289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.948575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.948674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.948850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.949135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.949420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.949695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.961895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.962175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.962450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.962736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.963010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.963287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.963566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.969381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.969705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.970084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.970378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.970839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.971128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.971407 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.981994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.985268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.989150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.990742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.991322 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.992389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:45.992665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.992951 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:45.996290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:46.000294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.002317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.002740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:46.004913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.005979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.006266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.006546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.006815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.007524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:46.007929 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.008385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.015954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:46.016271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.016574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.020769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.023312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:46.025254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79871) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:46.025254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.025254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.026423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.026698 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.026983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.027255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.027527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.027790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.027936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.028074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.028330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.028476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.028624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.028766 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.028903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.029105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79871) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.029260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.043165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:46.043462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.043744 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.052228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 11:51:46.052509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.052786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.053059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.053330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.053617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.053898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.054173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.054441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.054715 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.054983 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.055255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.055517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.055773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 11:51:46.069334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dde16ee9c0 pid: 79871 (default app) May 17 11:51:46.072740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c5f35-d4a8-4fff-8e0b-34194463ae5b None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:46.073033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c5f35-d4a8-4fff-8e0b-34194463ae5b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:46.073316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c5f35-d4a8-4fff-8e0b-34194463ae5b None None] PATH_INFO: `/v3` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:46.079429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Tue May 17 11:51:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:51:46.095637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dde16ee9c0 pid: 79870 (default app) May 17 11:51:54.024482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558bad4-06b7-4400-ba6d-f04ebe71881f None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:54.025058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558bad4-06b7-4400-ba6d-f04ebe71881f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:54.025058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558bad4-06b7-4400-ba6d-f04ebe71881f None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:54.026353 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:51:54.034709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e885-5e83-44b8-8ea6-8403dc0916a7 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:54.035119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e885-5e83-44b8-8ea6-8403dc0916a7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:54.035285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15e885-5e83-44b8-8ea6-8403dc0916a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:54.065977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG oslo_db.sqlalchemy.engines [None req-ac15e885-5e83-44b8-8ea6-8403dc0916a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 11:51:54.248240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG passlib.handlers.bcrypt [None req-ac15e885-5e83-44b8-8ea6-8403dc0916a7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79870) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 11:51:54.248750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG passlib.handlers.bcrypt [None req-ac15e885-5e83-44b8-8ea6-8403dc0916a7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79870) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 11:51:54.306262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ac15e885-5e83-44b8-8ea6-8403dc0916a7 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:51:54.308377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ac15e885-5e83-44b8-8ea6-8403dc0916a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:51:54.431227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1/3] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:51:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 17 11:51:54.602098 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558bad4-06b7-4400-ba6d-f04ebe71881f None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:51:54.637059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG oslo_db.sqlalchemy.engines [None req-3558bad4-06b7-4400-ba6d-f04ebe71881f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 11:51:54.768406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558bad4-06b7-4400-ba6d-f04ebe71881f None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:51:54.772643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe91f3a-f194-44a3-b60b-16b2624ff169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:51:54.773295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe91f3a-f194-44a3-b60b-16b2624ff169 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:54.773574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe91f3a-f194-44a3-b60b-16b2624ff169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:54.773846 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe91f3a-f194-44a3-b60b-16b2624ff169 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:54.782042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe91f3a-f194-44a3-b60b-16b2624ff169 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:51:54.835109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bbe91f3a-f194-44a3-b60b-16b2624ff169 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 11:51:54.835448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe91f3a-f194-44a3-b60b-16b2624ff169 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:51:54.845687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 3/4] 10.222.0.58 () {58 vars in 1324 bytes} [Tue May 17 11:51:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 11:51:54.851560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15e885-5e83-44b8-8ea6-8403dc0916a7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:51:54.865994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15e885-5e83-44b8-8ea6-8403dc0916a7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:51:54.870295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4030b-e949-4ffd-9c24-9f99936e64a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:51:54.871397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4030b-e949-4ffd-9c24-9f99936e64a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:54.871682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4030b-e949-4ffd-9c24-9f99936e64a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:54.871961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4030b-e949-4ffd-9c24-9f99936e64a1 admin admin] PATH_INFO: `/v3/projects/2acfce5cbf9f4de7bfe02428af601440` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:54.873493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4030b-e949-4ffd-9c24-9f99936e64a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=2acfce5cbf9f4de7bfe02428af601440)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:51:54.923551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cce4030b-e949-4ffd-9c24-9f99936e64a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 11:51:54.923883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4030b-e949-4ffd-9c24-9f99936e64a1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:51:54.928418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 2/5] 10.222.0.58 () {56 vars in 1207 bytes} [Tue May 17 11:51:54 2022] GET /identity/v3/projects/2acfce5cbf9f4de7bfe02428af601440 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:51:57.167002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51eb4-77b3-4639-8052-c5f7620335d9 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:57.167556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51eb4-77b3-4639-8052-c5f7620335d9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:57.167556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f51eb4-77b3-4639-8052-c5f7620335d9 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:57.171631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 4/6] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:51:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:51:57.177214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb560a72-016a-4d36-8464-897a28a04ffd None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:57.177623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb560a72-016a-4d36-8464-897a28a04ffd None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:57.177785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb560a72-016a-4d36-8464-897a28a04ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:57.197682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-eb560a72-016a-4d36-8464-897a28a04ffd None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:51:57.199177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-eb560a72-016a-4d36-8464-897a28a04ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:51:57.207604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 3/7] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:51:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 17 11:51:57.230182 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f51eb4-77b3-4639-8052-c5f7620335d9 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:51:57.242609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f51eb4-77b3-4639-8052-c5f7620335d9 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:51:57.246775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb7214-3c4d-472a-8adc-fecad012b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:51:57.247404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb7214-3c4d-472a-8adc-fecad012b35c admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:57.247687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb7214-3c4d-472a-8adc-fecad012b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:57.247961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb7214-3c4d-472a-8adc-fecad012b35c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:57.256490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb7214-3c4d-472a-8adc-fecad012b35c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:51:57.258268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb7214-3c4d-472a-8adc-fecad012b35c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:51:57.266857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 5/8] 10.222.0.58 () {58 vars in 1324 bytes} [Tue May 17 11:51:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 11:51:57.272186 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb560a72-016a-4d36-8464-897a28a04ffd None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:51:57.280925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb560a72-016a-4d36-8464-897a28a04ffd None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:51:57.285867 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d6339-6fad-4f65-a0af-02b6077959a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:51:57.286716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d6339-6fad-4f65-a0af-02b6077959a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:57.287002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d6339-6fad-4f65-a0af-02b6077959a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:57.287279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d6339-6fad-4f65-a0af-02b6077959a1 admin admin] PATH_INFO: `/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:57.288682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d6339-6fad-4f65-a0af-02b6077959a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=f0ae019bc4584bc39f9f7fb0d0af90e6)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:51:57.290487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d6339-6fad-4f65-a0af-02b6077959a1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:51:57.292029 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 4/9] 10.222.0.58 () {56 vars in 1198 bytes} [Tue May 17 11:51:57 2022] GET /identity/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:51:59.546571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5648-5802-495a-a575-007dd72bd682 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:59.547045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5648-5802-495a-a575-007dd72bd682 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:59.547133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5648-5802-495a-a575-007dd72bd682 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:59.548609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:51:59.553717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2e4aa-600b-49cb-b666-42ea15a71200 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:59.554140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2e4aa-600b-49cb-b666-42ea15a71200 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:59.554272 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2e4aa-600b-49cb-b666-42ea15a71200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:59.592822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874f26-1570-4a91-9a6f-cfa292835cad None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:59.593112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874f26-1570-4a91-9a6f-cfa292835cad None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:59.593396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874f26-1570-4a91-9a6f-cfa292835cad None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:59.595516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 7/11] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:51:59.601096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741ea4-791d-4d3d-bfd5-6c0d57201ff9 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:59.601387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741ea4-791d-4d3d-bfd5-6c0d57201ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:59.601675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75741ea4-791d-4d3d-bfd5-6c0d57201ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:59.643892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG passlib.handlers.bcrypt [None req-75741ea4-791d-4d3d-bfd5-6c0d57201ff9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79871) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 11:51:59.644365 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG passlib.handlers.bcrypt [None req-75741ea4-791d-4d3d-bfd5-6c0d57201ff9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79871) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 11:51:59.681119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c1c2e4aa-600b-49cb-b666-42ea15a71200 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:51:59.682303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c1c2e4aa-600b-49cb-b666-42ea15a71200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:51:59.692170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-75741ea4-791d-4d3d-bfd5-6c0d57201ff9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:51:59.693752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-75741ea4-791d-4d3d-bfd5-6c0d57201ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:51:59.759084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 5/12] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:51:59.781656 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2e4aa-600b-49cb-b666-42ea15a71200 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:51:59.792570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 8/13] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:51:59.815304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75741ea4-791d-4d3d-bfd5-6c0d57201ff9 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:51:59.878063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2e4aa-600b-49cb-b666-42ea15a71200 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:51:59.909871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7489-d001-4885-9a48-66e057109884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:51:59.910085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75741ea4-791d-4d3d-bfd5-6c0d57201ff9 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:51:59.910666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7489-d001-4885-9a48-66e057109884 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:59.910948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7489-d001-4885-9a48-66e057109884 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:59.911219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e7489-d001-4885-9a48-66e057109884 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:51:59.921927 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e7489-d001-4885-9a48-66e057109884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-6e0e7489-d001-4885-9a48-66e057109884 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:51:59.933446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:51:59.934678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:51:59.935857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 6/14] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:51:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:51:59.941401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7489-d001-4885-9a48-66e057109884 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:51:59.944683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c484e0-d473-4e4a-97f5-d18f0fbbb8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:51:59.945591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c484e0-d473-4e4a-97f5-d18f0fbbb8fe None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:51:59.945878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c484e0-d473-4e4a-97f5-d18f0fbbb8fe None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:51:59.946153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c484e0-d473-4e4a-97f5-d18f0fbbb8fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:00.009389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c484e0-d473-4e4a-97f5-d18f0fbbb8fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:00.010893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c484e0-d473-4e4a-97f5-d18f0fbbb8fe None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:00.035133 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e7489-d001-4885-9a48-66e057109884 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:00.068528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594464c-bd98-429b-8c37-260adf0a837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:00.069497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594464c-bd98-429b-8c37-260adf0a837c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:00.069918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594464c-bd98-429b-8c37-260adf0a837c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:00.070334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594464c-bd98-429b-8c37-260adf0a837c None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:00.071485 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594464c-bd98-429b-8c37-260adf0a837c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:00.071961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594464c-bd98-429b-8c37-260adf0a837c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:00.074164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594464c-bd98-429b-8c37-260adf0a837c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:00.091099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 7/15] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:51:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:00.097005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594464c-bd98-429b-8c37-260adf0a837c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:00.101061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 9/16] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 11:52:00.106608 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c484e0-d473-4e4a-97f5-d18f0fbbb8fe None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:00.198301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594464c-bd98-429b-8c37-260adf0a837c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:00.201979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c484e0-d473-4e4a-97f5-d18f0fbbb8fe None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:00.231411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56f797-9b09-45b0-8151-b1de1824a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:00.232310 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56f797-9b09-45b0-8151-b1de1824a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:00.232533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac706d5-13a5-4fc4-937e-b5639e96c6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:00.232635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56f797-9b09-45b0-8151-b1de1824a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:00.232868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56f797-9b09-45b0-8151-b1de1824a4c3 None admin] PATH_INFO: `/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:00.233306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac706d5-13a5-4fc4-937e-b5639e96c6ad None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:00.233585 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac706d5-13a5-4fc4-937e-b5639e96c6ad None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:00.233858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac706d5-13a5-4fc4-937e-b5639e96c6ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:00.234104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56f797-9b09-45b0-8151-b1de1824a4c3 None admin] RBAC: Authorizing `identity:get_user(user_id=f0ae019bc4584bc39f9f7fb0d0af90e6)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:00.236230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56f797-9b09-45b0-8151-b1de1824a4c3 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:00.237843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 8/17] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:00 2022] GET /identity/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:00.243439 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56f797-9b09-45b0-8151-b1de1824a4c3 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:00.346449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56f797-9b09-45b0-8151-b1de1824a4c3 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:00.360781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac706d5-13a5-4fc4-937e-b5639e96c6ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:00.362235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac706d5-13a5-4fc4-937e-b5639e96c6ad None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:00.379461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a42cc2-0438-4180-a043-93847b8647ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:00.380286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42cc2-0438-4180-a043-93847b8647ce None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:00.380573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42cc2-0438-4180-a043-93847b8647ce None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:00.380850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a42cc2-0438-4180-a043-93847b8647ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:00.382135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a42cc2-0438-4180-a043-93847b8647ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-fac706d5-13a5-4fc4-937e-b5639e96c6ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:52:00.383053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:00.384003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:00.384910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:52:00.384910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:52:00.384910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:52:00.384910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:00.385127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a42cc2-0438-4180-a043-93847b8647ce None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:00.385190 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 9/18] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:00.388325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 10/19] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:00.389852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a42cc2-0438-4180-a043-93847b8647ce None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:00.390532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac706d5-13a5-4fc4-937e-b5639e96c6ad None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:00.485710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a42cc2-0438-4180-a043-93847b8647ce None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:00.485917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac706d5-13a5-4fc4-937e-b5639e96c6ad None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:00.518147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7db23b-0517-4fb7-9a19-f563b1857633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:00.518405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78529e87-6aba-432e-8d92-44262e49c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:00.518796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7db23b-0517-4fb7-9a19-f563b1857633 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:00.519061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529e87-6aba-432e-8d92-44262e49c622 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:00.519153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7db23b-0517-4fb7-9a19-f563b1857633 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:00.519333 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7db23b-0517-4fb7-9a19-f563b1857633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:00.519443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529e87-6aba-432e-8d92-44262e49c622 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:00.519619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529e87-6aba-432e-8d92-44262e49c622 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:00.520155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7db23b-0517-4fb7-9a19-f563b1857633 None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.domain.id=default, user.id=f0ae019bc4584bc39f9f7fb0d0af90e6) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:00.520367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78529e87-6aba-432e-8d92-44262e49c622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:00.520496 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7db23b-0517-4fb7-9a19-f563b1857633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:00.520672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78529e87-6aba-432e-8d92-44262e49c622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:00.521933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7db23b-0517-4fb7-9a19-f563b1857633 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:00.522023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78529e87-6aba-432e-8d92-44262e49c622 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:00.530047 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 11/20] 10.222.0.58 () {56 vars in 1322 bytes} [Tue May 17 11:52:00 2022] GET /identity/v3/role_assignments?user.id=f0ae019bc4584bc39f9f7fb0d0af90e6&scope.domain.id=default&role.id=3db33dfd3d6544fd81933007633fc56a => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:00.540060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 10/21] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:03.198500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484ce9-a32e-431e-bc35-09a4ba079987 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:03.199014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484ce9-a32e-431e-bc35-09a4ba079987 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:03.199290 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484ce9-a32e-431e-bc35-09a4ba079987 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:03.200712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 12/22] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:03.206914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74852c9-9d95-47b3-9dff-e531066fe766 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:03.207408 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74852c9-9d95-47b3-9dff-e531066fe766 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:03.207478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74852c9-9d95-47b3-9dff-e531066fe766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:03.229968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-e74852c9-9d95-47b3-9dff-e531066fe766 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:03.231205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e74852c9-9d95-47b3-9dff-e531066fe766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:03.311576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 11/23] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:03.346378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47484ce9-a32e-431e-bc35-09a4ba079987 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:03.384389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191d9fe-d217-4c72-9483-46b4afea65e8 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:03.385003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191d9fe-d217-4c72-9483-46b4afea65e8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:03.385502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191d9fe-d217-4c72-9483-46b4afea65e8 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:03.387377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 12/24] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:03.393380 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99f39-4ef2-4230-a4a1-fe088928b59f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:03.393923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99f39-4ef2-4230-a4a1-fe088928b59f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:03.394411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99f39-4ef2-4230-a4a1-fe088928b59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:03.433232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-47a99f39-4ef2-4230-a4a1-fe088928b59f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:03.434704 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-47a99f39-4ef2-4230-a4a1-fe088928b59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:03.502725 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47484ce9-a32e-431e-bc35-09a4ba079987 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:03.514085 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 13/25] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:03.515522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab93018-2d6b-40c9-988d-1aa3d7af6aa8 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:03.515824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab93018-2d6b-40c9-988d-1aa3d7af6aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:03.516108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab93018-2d6b-40c9-988d-1aa3d7af6aa8 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:03.518649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 14/26] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:03.529377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9ad46-1e34-4e07-bb9d-50fcd560a326 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:03.529820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9ad46-1e34-4e07-bb9d-50fcd560a326 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:03.530290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9ad46-1e34-4e07-bb9d-50fcd560a326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:03.554168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-d3b9ad46-1e34-4e07-bb9d-50fcd560a326 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:03.555572 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-d3b9ad46-1e34-4e07-bb9d-50fcd560a326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:03.584907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43e525-aad2-4989-a0c7-84aa9b0d24d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:03.585720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e525-aad2-4989-a0c7-84aa9b0d24d5 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:03.586195 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e525-aad2-4989-a0c7-84aa9b0d24d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:03.586630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e525-aad2-4989-a0c7-84aa9b0d24d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:03.613089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43e525-aad2-4989-a0c7-84aa9b0d24d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-7f43e525-aad2-4989-a0c7-84aa9b0d24d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:03.628203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:03.629384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:03.630202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:03.630848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 15/27] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:03.630848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9ad46-1e34-4e07-bb9d-50fcd560a326 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:03.633519 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 13/28] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:03.638084 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43e525-aad2-4989-a0c7-84aa9b0d24d5 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:03.764823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9ad46-1e34-4e07-bb9d-50fcd560a326 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:03.811264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c2f39-6484-4d25-82c9-b29eb5731275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:03.812082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2f39-6484-4d25-82c9-b29eb5731275 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:03.812875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2f39-6484-4d25-82c9-b29eb5731275 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:03.813256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2f39-6484-4d25-82c9-b29eb5731275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:03.819503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43e525-aad2-4989-a0c7-84aa9b0d24d5 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:03.829265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c2f39-6484-4d25-82c9-b29eb5731275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:03.830965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c2f39-6484-4d25-82c9-b29eb5731275 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-ff1c2f39-6484-4d25-82c9-b29eb5731275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:52:03.859822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:03.861300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:03.862140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:52:03.862140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:52:03.862140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:52:03.862140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:03.862559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 16/29] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:03.863478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c2f39-6484-4d25-82c9-b29eb5731275 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:03.890133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a5876-58d0-4d44-84cd-59ddf9dfcdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:03.890824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a5876-58d0-4d44-84cd-59ddf9dfcdde None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:03.891115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a5876-58d0-4d44-84cd-59ddf9dfcdde None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:03.892120 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a5876-58d0-4d44-84cd-59ddf9dfcdde None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:03.892946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a5876-58d0-4d44-84cd-59ddf9dfcdde None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:03.893377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a5876-58d0-4d44-84cd-59ddf9dfcdde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:03.894743 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a5876-58d0-4d44-84cd-59ddf9dfcdde None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:03.925253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 14/30] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:03.926237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a5876-58d0-4d44-84cd-59ddf9dfcdde None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:03.980131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c2f39-6484-4d25-82c9-b29eb5731275 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:04.019838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f16c37-2c7e-4868-b7c9-50166dd36619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:04.020836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16c37-2c7e-4868-b7c9-50166dd36619 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:04.021267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16c37-2c7e-4868-b7c9-50166dd36619 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:04.021689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16c37-2c7e-4868-b7c9-50166dd36619 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:04.022625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f16c37-2c7e-4868-b7c9-50166dd36619 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:04.024246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f16c37-2c7e-4868-b7c9-50166dd36619 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:04.071521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a5876-58d0-4d44-84cd-59ddf9dfcdde None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:04.115598 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d1b1d-e068-4cf8-9a79-b4367e1aa036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:04.116566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d1b1d-e068-4cf8-9a79-b4367e1aa036 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:04.116998 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d1b1d-e068-4cf8-9a79-b4367e1aa036 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:04.117416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d1b1d-e068-4cf8-9a79-b4367e1aa036 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:04.118354 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d1b1d-e068-4cf8-9a79-b4367e1aa036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:04.118814 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d1b1d-e068-4cf8-9a79-b4367e1aa036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:04.124585 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d1b1d-e068-4cf8-9a79-b4367e1aa036 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:04.156072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 15/31] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:04.157669 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d1b1d-e068-4cf8-9a79-b4367e1aa036 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:04.192924 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 17/32] 10.222.0.58 () {60 vars in 1131 bytes} [Tue May 17 11:52:03 2022] POST /identity/v3/roles => generated 219 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:04.193676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f16c37-2c7e-4868-b7c9-50166dd36619 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:04.319230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f16c37-2c7e-4868-b7c9-50166dd36619 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:04.356450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8142c5d-51a5-4fdb-9413-bd06a41d3c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:04.357139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142c5d-51a5-4fdb-9413-bd06a41d3c3e None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:04.357425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142c5d-51a5-4fdb-9413-bd06a41d3c3e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:04.357701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142c5d-51a5-4fdb-9413-bd06a41d3c3e None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:04.358433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8142c5d-51a5-4fdb-9413-bd06a41d3c3e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:04.360117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8142c5d-51a5-4fdb-9413-bd06a41d3c3e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:04.385764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d1b1d-e068-4cf8-9a79-b4367e1aa036 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:04.393613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 18/33] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:52:04 2022] POST /identity/v3/projects => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:04.395097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b994f6-e034-4ca8-8d3f-150df7ba4f22 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:04.395450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b994f6-e034-4ca8-8d3f-150df7ba4f22 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:04.395734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b994f6-e034-4ca8-8d3f-150df7ba4f22 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:04.397887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 19/34] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:04.399219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05778fe-531f-479e-88fb-a946f4f7f347 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:04.399510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05778fe-531f-479e-88fb-a946f4f7f347 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:04.399768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05778fe-531f-479e-88fb-a946f4f7f347 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:04.402035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 20/35] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:04.405812 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293f6d-fe57-49fa-a936-326be0320015 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:04.406657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293f6d-fe57-49fa-a936-326be0320015 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:04.407045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293f6d-fe57-49fa-a936-326be0320015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:04.425630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1e293f6d-fe57-49fa-a936-326be0320015 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:04.427520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1e293f6d-fe57-49fa-a936-326be0320015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:04.436714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57cedc-004c-4189-a9e1-e08ba883d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:04.438502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57cedc-004c-4189-a9e1-e08ba883d034 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:04.439574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57cedc-004c-4189-a9e1-e08ba883d034 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:04.440069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57cedc-004c-4189-a9e1-e08ba883d034 None admin] PATH_INFO: `/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:04.442363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57cedc-004c-4189-a9e1-e08ba883d034 None admin] RBAC: Authorizing `identity:get_user(user_id=f0ae019bc4584bc39f9f7fb0d0af90e6)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:04.444491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57cedc-004c-4189-a9e1-e08ba883d034 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:04.447122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 16/36] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:04 2022] GET /identity/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6 => generated 247 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:04.448827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d11b5-ea57-4fc7-a5b1-d932a50ff99c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:04.449311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d11b5-ea57-4fc7-a5b1-d932a50ff99c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:04.449780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d11b5-ea57-4fc7-a5b1-d932a50ff99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:04.469572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-792d11b5-ea57-4fc7-a5b1-d932a50ff99c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:04.471192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-792d11b5-ea57-4fc7-a5b1-d932a50ff99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:04.503953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 21/37] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:04.505166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e293f6d-fe57-49fa-a936-326be0320015 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:04.558019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 17/38] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:04.559187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d11b5-ea57-4fc7-a5b1-d932a50ff99c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:04.621598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e293f6d-fe57-49fa-a936-326be0320015 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:04.661011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b39176-2b2e-4d9b-9aa9-3c5374ef21eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:04.662157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b39176-2b2e-4d9b-9aa9-3c5374ef21eb None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:04.662650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b39176-2b2e-4d9b-9aa9-3c5374ef21eb None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:04.663124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b39176-2b2e-4d9b-9aa9-3c5374ef21eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:04.664605 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b39176-2b2e-4d9b-9aa9-3c5374ef21eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:04.666356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b39176-2b2e-4d9b-9aa9-3c5374ef21eb None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:04.668224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 22/39] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:04.668783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b39176-2b2e-4d9b-9aa9-3c5374ef21eb None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:04.699524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d11b5-ea57-4fc7-a5b1-d932a50ff99c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:04.735746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cabb1a-0e93-4d36-88de-3c3bc29bbb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:04.736805 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cabb1a-0e93-4d36-88de-3c3bc29bbb45 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:04.737241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cabb1a-0e93-4d36-88de-3c3bc29bbb45 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:04.737518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cabb1a-0e93-4d36-88de-3c3bc29bbb45 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:04.738284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cabb1a-0e93-4d36-88de-3c3bc29bbb45 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:04.739684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cabb1a-0e93-4d36-88de-3c3bc29bbb45 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:04.782601 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b39176-2b2e-4d9b-9aa9-3c5374ef21eb None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:04.815515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db033c-75bf-460f-9ef5-61a3a7df01e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:04.816197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db033c-75bf-460f-9ef5-61a3a7df01e8 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:04.816500 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db033c-75bf-460f-9ef5-61a3a7df01e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:04.816780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db033c-75bf-460f-9ef5-61a3a7df01e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:04.817524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db033c-75bf-460f-9ef5-61a3a7df01e8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:04.818910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db033c-75bf-460f-9ef5-61a3a7df01e8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:04.833276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 23/40] 10.222.0.58 () {60 vars in 1131 bytes} [Tue May 17 11:52:04 2022] POST /identity/v3/roles => generated 223 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:04.833874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db033c-75bf-460f-9ef5-61a3a7df01e8 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:04.876938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 18/41] 10.222.0.58 () {60 vars in 1131 bytes} [Tue May 17 11:52:04 2022] POST /identity/v3/roles => generated 225 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:04.982672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db033c-75bf-460f-9ef5-61a3a7df01e8 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:05.024953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4936728-e756-4f0f-a36a-0b81c761af86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:05.025862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4936728-e756-4f0f-a36a-0b81c761af86 None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:05.026150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4936728-e756-4f0f-a36a-0b81c761af86 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:05.026435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4936728-e756-4f0f-a36a-0b81c761af86 None admin] PATH_INFO: `/v3/domains/default/users/f0ae019bc4584bc39f9f7fb0d0af90e6/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:05.028709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4936728-e756-4f0f-a36a-0b81c761af86 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f0ae019bc4584bc39f9f7fb0d0af90e6, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:05.030256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4936728-e756-4f0f-a36a-0b81c761af86 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:05.048640 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 24/42] 10.222.0.58 () {58 vars in 1361 bytes} [Tue May 17 11:52:04 2022] PUT /identity/v3/domains/default/users/f0ae019bc4584bc39f9f7fb0d0af90e6/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:05.128294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a109c1-50c9-4ffe-b4cb-66d44d3b87c3 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:05.128529 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a109c1-50c9-4ffe-b4cb-66d44d3b87c3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:05.128969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a109c1-50c9-4ffe-b4cb-66d44d3b87c3 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:05.130658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 19/43] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:05.136682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0d338-cfc0-4ef6-8808-61fa1964aa1b None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:05.136998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0d338-cfc0-4ef6-8808-61fa1964aa1b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:05.137266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0d338-cfc0-4ef6-8808-61fa1964aa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:05.156630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-22b0d338-cfc0-4ef6-8808-61fa1964aa1b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:05.158651 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-22b0d338-cfc0-4ef6-8808-61fa1964aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:05.240784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 25/44] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:05.264558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a109c1-50c9-4ffe-b4cb-66d44d3b87c3 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:05.365011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a109c1-50c9-4ffe-b4cb-66d44d3b87c3 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:05.396926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46b9c6-76a0-44c4-8fe5-a7fd8a5be1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:05.397730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b9c6-76a0-44c4-8fe5-a7fd8a5be1ac None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:05.398015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b9c6-76a0-44c4-8fe5-a7fd8a5be1ac None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:05.398292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b9c6-76a0-44c4-8fe5-a7fd8a5be1ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:05.399553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46b9c6-76a0-44c4-8fe5-a7fd8a5be1ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:05.401145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46b9c6-76a0-44c4-8fe5-a7fd8a5be1ac None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:05.402792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 20/45] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:05.408313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0d338-cfc0-4ef6-8808-61fa1964aa1b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:05.501829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0d338-cfc0-4ef6-8808-61fa1964aa1b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:05.538329 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886c11f-cb10-4dcc-9eac-36777349cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:05.539028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886c11f-cb10-4dcc-9eac-36777349cedc None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:05.539310 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886c11f-cb10-4dcc-9eac-36777349cedc None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:05.539586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886c11f-cb10-4dcc-9eac-36777349cedc None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:05.540338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886c11f-cb10-4dcc-9eac-36777349cedc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:05.541789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886c11f-cb10-4dcc-9eac-36777349cedc None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:05.566348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 26/46] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:52:05 2022] POST /identity/v3/projects => generated 312 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:52:07.325801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f38784-463e-4e71-afc9-f379068986d6 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:07.326340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f38784-463e-4e71-afc9-f379068986d6 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:07.326340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f38784-463e-4e71-afc9-f379068986d6 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:07.327730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 21/47] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:07.333815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b64257-c2a9-4a81-bc53-a2450acf389c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:07.334235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b64257-c2a9-4a81-bc53-a2450acf389c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:07.334385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b64257-c2a9-4a81-bc53-a2450acf389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:07.351429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-64b64257-c2a9-4a81-bc53-a2450acf389c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:07.352647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-64b64257-c2a9-4a81-bc53-a2450acf389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:07.415656 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 27/48] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:07.440630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f38784-463e-4e71-afc9-f379068986d6 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:07.543939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f38784-463e-4e71-afc9-f379068986d6 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:07.576936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d3572-0a81-4f40-a15c-1d8acb3e9e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:07.577654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d3572-0a81-4f40-a15c-1d8acb3e9e44 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:07.577939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d3572-0a81-4f40-a15c-1d8acb3e9e44 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:07.578214 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d3572-0a81-4f40-a15c-1d8acb3e9e44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:07.588102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d3572-0a81-4f40-a15c-1d8acb3e9e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-ff7d3572-0a81-4f40-a15c-1d8acb3e9e44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:07.595963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:07.596976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:07.597712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 22/49] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:52:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:07.603330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b64257-c2a9-4a81-bc53-a2450acf389c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:07.700098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b64257-c2a9-4a81-bc53-a2450acf389c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:07.731423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0974eb8-b0f1-4898-97cb-6ccb6b0dc084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:07.732081 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0974eb8-b0f1-4898-97cb-6ccb6b0dc084 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:07.732393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0974eb8-b0f1-4898-97cb-6ccb6b0dc084 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:07.732668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0974eb8-b0f1-4898-97cb-6ccb6b0dc084 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:07.733411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0974eb8-b0f1-4898-97cb-6ccb6b0dc084 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:07.733719 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0974eb8-b0f1-4898-97cb-6ccb6b0dc084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:07.735611 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0974eb8-b0f1-4898-97cb-6ccb6b0dc084 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:07.743346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 28/50] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:07.748867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d3572-0a81-4f40-a15c-1d8acb3e9e44 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:07.789525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7c8c-98dd-4e9f-9a2e-f40082d5961d None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:07.789819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7c8c-98dd-4e9f-9a2e-f40082d5961d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:07.790104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e7c8c-98dd-4e9f-9a2e-f40082d5961d None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:07.791482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 29/51] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:07.796443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22804554-9874-4d2b-9745-7a1b1735f7f8 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:07.796739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22804554-9874-4d2b-9745-7a1b1735f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:07.797024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22804554-9874-4d2b-9745-7a1b1735f7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:07.814052 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-22804554-9874-4d2b-9745-7a1b1735f7f8 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:07.815665 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-22804554-9874-4d2b-9745-7a1b1735f7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:07.846982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d3572-0a81-4f40-a15c-1d8acb3e9e44 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:07.878609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad72df-fc9e-440f-958e-41f330ac4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:07.879480 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad72df-fc9e-440f-958e-41f330ac4377 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:07.879763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad72df-fc9e-440f-958e-41f330ac4377 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:07.880041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad72df-fc9e-440f-958e-41f330ac4377 None admin] PATH_INFO: `/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:07.881341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad72df-fc9e-440f-958e-41f330ac4377 None admin] RBAC: Authorizing `identity:get_user(user_id=f0ae019bc4584bc39f9f7fb0d0af90e6)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:07.882320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 30/52] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:07.882811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad72df-fc9e-440f-958e-41f330ac4377 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:07.884455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 23/53] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:07 2022] GET /identity/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:07.889754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22804554-9874-4d2b-9745-7a1b1735f7f8 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:07.905412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad72df-fc9e-440f-958e-41f330ac4377 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:07.983542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22804554-9874-4d2b-9745-7a1b1735f7f8 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:08.001558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad72df-fc9e-440f-958e-41f330ac4377 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:08.015365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25af5b-52c9-4bd2-af47-ee81a90f0c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:08.016875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25af5b-52c9-4bd2-af47-ee81a90f0c1c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:08.017175 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25af5b-52c9-4bd2-af47-ee81a90f0c1c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:08.017457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25af5b-52c9-4bd2-af47-ee81a90f0c1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:08.018636 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25af5b-52c9-4bd2-af47-ee81a90f0c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:08.020099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25af5b-52c9-4bd2-af47-ee81a90f0c1c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:08.021734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 31/54] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:08.027321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25af5b-52c9-4bd2-af47-ee81a90f0c1c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:08.033660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7c698-11d0-46af-8a8b-c5a36625aa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:08.034449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7c698-11d0-46af-8a8b-c5a36625aa4e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:08.034735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7c698-11d0-46af-8a8b-c5a36625aa4e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:08.035013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7c698-11d0-46af-8a8b-c5a36625aa4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:08.036198 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7c698-11d0-46af-8a8b-c5a36625aa4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:08.037651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7c698-11d0-46af-8a8b-c5a36625aa4e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:08.039250 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 24/55] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:08.044685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7c698-11d0-46af-8a8b-c5a36625aa4e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:08.121442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25af5b-52c9-4bd2-af47-ee81a90f0c1c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:08.138096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7c698-11d0-46af-8a8b-c5a36625aa4e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:08.154688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0d2b7-dc96-4a82-bd4c-6b2fa472a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:08.155350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d2b7-dc96-4a82-bd4c-6b2fa472a511 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:08.155639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d2b7-dc96-4a82-bd4c-6b2fa472a511 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:08.155919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d2b7-dc96-4a82-bd4c-6b2fa472a511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:08.156897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0d2b7-dc96-4a82-bd4c-6b2fa472a511 None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.domain.id=default, user.id=f0ae019bc4584bc39f9f7fb0d0af90e6) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:08.157213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0d2b7-dc96-4a82-bd4c-6b2fa472a511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:08.158768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0d2b7-dc96-4a82-bd4c-6b2fa472a511 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:08.165621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 32/56] 10.222.0.58 () {56 vars in 1322 bytes} [Tue May 17 11:52:08 2022] GET /identity/v3/role_assignments?user.id=f0ae019bc4584bc39f9f7fb0d0af90e6&scope.domain.id=default&role.id=3db33dfd3d6544fd81933007633fc56a => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:08.170038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69315f74-b0b7-4f9a-a254-aa8b591d42fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:08.170718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69315f74-b0b7-4f9a-a254-aa8b591d42fd None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:08.171011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69315f74-b0b7-4f9a-a254-aa8b591d42fd None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:08.171297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69315f74-b0b7-4f9a-a254-aa8b591d42fd None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:08.172027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69315f74-b0b7-4f9a-a254-aa8b591d42fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:08.174229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69315f74-b0b7-4f9a-a254-aa8b591d42fd None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:08.204730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 25/57] 10.222.0.58 () {60 vars in 1140 bytes} [Tue May 17 11:52:08 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:52:10.439689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be25a19-f8d4-4edd-8638-3168c1d14cf9 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:10.440226 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be25a19-f8d4-4edd-8638-3168c1d14cf9 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:10.440404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be25a19-f8d4-4edd-8638-3168c1d14cf9 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:10.442026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 33/58] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:10.447609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67698463-2504-4e46-85f0-ab66d1fea101 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:10.448023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67698463-2504-4e46-85f0-ab66d1fea101 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:10.448202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67698463-2504-4e46-85f0-ab66d1fea101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:10.465721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-67698463-2504-4e46-85f0-ab66d1fea101 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:10.467208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-67698463-2504-4e46-85f0-ab66d1fea101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:10.530652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 26/59] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:10.556418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be25a19-f8d4-4edd-8638-3168c1d14cf9 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:10.653103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be25a19-f8d4-4edd-8638-3168c1d14cf9 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:10.683847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87039928-c882-48ba-876f-3d3a31138bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:10.684910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87039928-c882-48ba-876f-3d3a31138bed None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:10.685190 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87039928-c882-48ba-876f-3d3a31138bed None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:10.685462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87039928-c882-48ba-876f-3d3a31138bed None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:10.686608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87039928-c882-48ba-876f-3d3a31138bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:10.688692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87039928-c882-48ba-876f-3d3a31138bed None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:10.690303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 34/60] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:10.695687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67698463-2504-4e46-85f0-ab66d1fea101 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:10.788102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67698463-2504-4e46-85f0-ab66d1fea101 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:10.819708 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46954a7-17f8-452f-a1e9-68a3c8e5bfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:10.820392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46954a7-17f8-452f-a1e9-68a3c8e5bfd1 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:10.820676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46954a7-17f8-452f-a1e9-68a3c8e5bfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:10.820952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46954a7-17f8-452f-a1e9-68a3c8e5bfd1 None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:10.821649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46954a7-17f8-452f-a1e9-68a3c8e5bfd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:10.823082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46954a7-17f8-452f-a1e9-68a3c8e5bfd1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:10.847059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 27/61] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:52:10 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:14.253323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485994d-b16b-4a5f-b759-7c503c3e1ff3 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.254317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485994d-b16b-4a5f-b759-7c503c3e1ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.254797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485994d-b16b-4a5f-b759-7c503c3e1ff3 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.256421 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 35/62] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:14.262187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f7a0f-e509-4f10-afd3-94779b6ddf4a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.263054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f7a0f-e509-4f10-afd3-94779b6ddf4a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.263523 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f7a0f-e509-4f10-afd3-94779b6ddf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.280758 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-1a4f7a0f-e509-4f10-afd3-94779b6ddf4a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:14.282267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1a4f7a0f-e509-4f10-afd3-94779b6ddf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:14.356937 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 28/63] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:14.392147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485994d-b16b-4a5f-b759-7c503c3e1ff3 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:14.423103 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b9e5-e1ef-4656-91bb-4b3f496d7fa2 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.423440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b9e5-e1ef-4656-91bb-4b3f496d7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.423665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b9e5-e1ef-4656-91bb-4b3f496d7fa2 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.425079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 29/64] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:14.431099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6fa39-9374-40ef-9592-b4c834af479b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.431389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6fa39-9374-40ef-9592-b4c834af479b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.431670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6fa39-9374-40ef-9592-b4c834af479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.456590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-53e6fa39-9374-40ef-9592-b4c834af479b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:14.457809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-53e6fa39-9374-40ef-9592-b4c834af479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:14.562142 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 30/65] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:14.572921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f3f04-6048-4227-b700-9ba51b97ee28 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.573447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f3f04-6048-4227-b700-9ba51b97ee28 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.573918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f3f04-6048-4227-b700-9ba51b97ee28 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.575773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485994d-b16b-4a5f-b759-7c503c3e1ff3 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:14.575933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 31/66] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:14.581066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b0c5-26ad-42aa-b247-5b30d8d845e9 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.581555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b0c5-26ad-42aa-b247-5b30d8d845e9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.582003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b0c5-26ad-42aa-b247-5b30d8d845e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.609401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f882b0c5-26ad-42aa-b247-5b30d8d845e9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:14.611527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f882b0c5-26ad-42aa-b247-5b30d8d845e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:14.613912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac0e20-41b0-4d35-8875-71ec34293939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:14.615015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0e20-41b0-4d35-8875-71ec34293939 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.615305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0e20-41b0-4d35-8875-71ec34293939 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.615588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0e20-41b0-4d35-8875-71ec34293939 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.631852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac0e20-41b0-4d35-8875-71ec34293939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-feac0e20-41b0-4d35-8875-71ec34293939 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:14.642757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:14.643762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:14.644553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:14.645113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 36/67] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:14.650001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac0e20-41b0-4d35-8875-71ec34293939 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:14.699654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 32/68] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:14.700949 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882b0c5-26ad-42aa-b247-5b30d8d845e9 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:14.750976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac0e20-41b0-4d35-8875-71ec34293939 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:14.785855 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9c58f-bc3a-4e18-a9fd-08631cf0cbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:14.786571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9c58f-bc3a-4e18-a9fd-08631cf0cbf9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.786859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9c58f-bc3a-4e18-a9fd-08631cf0cbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.787137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9c58f-bc3a-4e18-a9fd-08631cf0cbf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.797070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9c58f-bc3a-4e18-a9fd-08631cf0cbf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:14.800432 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882b0c5-26ad-42aa-b247-5b30d8d845e9 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-98d9c58f-bc3a-4e18-a9fd-08631cf0cbf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:14.804977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:14.805805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:14.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 37/69] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:52:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:14.807655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04568b0c-6270-415d-b0a3-9e2a545eec69 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.807806 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04568b0c-6270-415d-b0a3-9e2a545eec69 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.808090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04568b0c-6270-415d-b0a3-9e2a545eec69 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.809374 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 38/70] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:14.812008 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04568b0c-6270-415d-b0a3-9e2a545eec69 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:14.834487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95693235-5fb4-4a2e-9df4-31a498ac5e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:14.835153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693235-5fb4-4a2e-9df4-31a498ac5e60 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.835434 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693235-5fb4-4a2e-9df4-31a498ac5e60 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.835706 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693235-5fb4-4a2e-9df4-31a498ac5e60 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.836488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95693235-5fb4-4a2e-9df4-31a498ac5e60 None admin] RBAC: Adding query filter params (name=member) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:14.836796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95693235-5fb4-4a2e-9df4-31a498ac5e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:14.838179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95693235-5fb4-4a2e-9df4-31a498ac5e60 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:14.850823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 33/71] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:14.850823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9934c9-1995-4a96-a53c-dda7a9242ebe None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.850823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9934c9-1995-4a96-a53c-dda7a9242ebe None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.850823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9934c9-1995-4a96-a53c-dda7a9242ebe None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.850823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 34/72] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:14.850823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9934c9-1995-4a96-a53c-dda7a9242ebe None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:14.909612 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04568b0c-6270-415d-b0a3-9e2a545eec69 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:14.940672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f8f2b-9910-4d64-aeb9-190ad1784ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:14.941462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f8f2b-9910-4d64-aeb9-190ad1784ce7 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.941744 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f8f2b-9910-4d64-aeb9-190ad1784ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.942019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f8f2b-9910-4d64-aeb9-190ad1784ce7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.946571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9934c9-1995-4a96-a53c-dda7a9242ebe None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:14.951516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f8f2b-9910-4d64-aeb9-190ad1784ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-820f8f2b-9910-4d64-aeb9-190ad1784ce7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:14.960274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:14.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:14.962097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 39/73] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:52:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:14.962701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934da06-f502-4355-8123-29adeb6c7fb4 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.962882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934da06-f502-4355-8123-29adeb6c7fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.963139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934da06-f502-4355-8123-29adeb6c7fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.979426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-3934da06-f502-4355-8123-29adeb6c7fb4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:14.980638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3934da06-f502-4355-8123-29adeb6c7fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:14.985163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc883c9f-a587-40ea-8311-985e8b09f9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:14.985856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc883c9f-a587-40ea-8311-985e8b09f9b9 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:14.986138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc883c9f-a587-40ea-8311-985e8b09f9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:14.986423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc883c9f-a587-40ea-8311-985e8b09f9b9 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:14.987180 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc883c9f-a587-40ea-8311-985e8b09f9b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:14.987503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc883c9f-a587-40ea-8311-985e8b09f9b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:14.988906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc883c9f-a587-40ea-8311-985e8b09f9b9 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:14.997234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 35/74] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:14.998024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc883c9f-a587-40ea-8311-985e8b09f9b9 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:15.043693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 40/75] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:15.044977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b4c1-7f03-40a7-9857-b6561075a463 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:15.045275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b4c1-7f03-40a7-9857-b6561075a463 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:15.045554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4b4c1-7f03-40a7-9857-b6561075a463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:15.071000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-9fe4b4c1-7f03-40a7-9857-b6561075a463 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:15.072157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9fe4b4c1-7f03-40a7-9857-b6561075a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:15.094783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc883c9f-a587-40ea-8311-985e8b09f9b9 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:15.126333 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108758f-0848-4011-808a-b99df4ea3cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:15.127189 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108758f-0848-4011-808a-b99df4ea3cc3 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:15.127468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108758f-0848-4011-808a-b99df4ea3cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:15.127743 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108758f-0848-4011-808a-b99df4ea3cc3 None admin] PATH_INFO: `/v3/users/a8842ef81bce467bbeb3e3cf1f632151` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:15.134284 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 41/76] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:15.146404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4b4c1-7f03-40a7-9857-b6561075a463 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:15.146515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108758f-0848-4011-808a-b99df4ea3cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=a8842ef81bce467bbeb3e3cf1f632151)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:15.146515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108758f-0848-4011-808a-b99df4ea3cc3 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:15.146515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 36/77] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:14 2022] GET /identity/v3/users/a8842ef81bce467bbeb3e3cf1f632151 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:15.147119 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108758f-0848-4011-808a-b99df4ea3cc3 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:15.237912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4b4c1-7f03-40a7-9857-b6561075a463 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:15.250385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108758f-0848-4011-808a-b99df4ea3cc3 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:15.270100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9905949-d989-42c5-927c-72f77dad74cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:15.270769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905949-d989-42c5-927c-72f77dad74cc None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:15.271051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905949-d989-42c5-927c-72f77dad74cc None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:15.271332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905949-d989-42c5-927c-72f77dad74cc None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:15.272075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9905949-d989-42c5-927c-72f77dad74cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:15.272413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9905949-d989-42c5-927c-72f77dad74cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:15.273798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9905949-d989-42c5-927c-72f77dad74cc None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:15.281354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 42/78] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:52:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:15.282736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9905949-d989-42c5-927c-72f77dad74cc None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:15.290414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4acca-4b5a-4dae-89e2-3ed207bb54b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:15.291287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4acca-4b5a-4dae-89e2-3ed207bb54b9 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:15.291574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4acca-4b5a-4dae-89e2-3ed207bb54b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:15.291855 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4acca-4b5a-4dae-89e2-3ed207bb54b9 None admin] PATH_INFO: `/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:15.293113 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4acca-4b5a-4dae-89e2-3ed207bb54b9 None admin] RBAC: Authorizing `identity:get_user(user_id=f0ae019bc4584bc39f9f7fb0d0af90e6)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:15.294609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4acca-4b5a-4dae-89e2-3ed207bb54b9 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:15.296196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 37/79] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:15 2022] GET /identity/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:15.297023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4acca-4b5a-4dae-89e2-3ed207bb54b9 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:15.378885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9905949-d989-42c5-927c-72f77dad74cc None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:15.392908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4acca-4b5a-4dae-89e2-3ed207bb54b9 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:15.410980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60ffd-11b7-4a22-8f5b-492c92c254fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:15.411770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60ffd-11b7-4a22-8f5b-492c92c254fa None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:15.412049 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60ffd-11b7-4a22-8f5b-492c92c254fa None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:15.412348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60ffd-11b7-4a22-8f5b-492c92c254fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:15.421873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e60ffd-11b7-4a22-8f5b-492c92c254fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:15.424468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e0337-aab4-443f-9285-91c07cc7a4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:15.425106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0337-aab4-443f-9285-91c07cc7a4c0 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:15.425388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0337-aab4-443f-9285-91c07cc7a4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:15.425665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0337-aab4-443f-9285-91c07cc7a4c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-10e60ffd-11b7-4a22-8f5b-492c92c254fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:15.429724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:15.430528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:15.431292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 43/80] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:15.431930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60ffd-11b7-4a22-8f5b-492c92c254fa None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:15.488989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e0337-aab4-443f-9285-91c07cc7a4c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:15.490442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e0337-aab4-443f-9285-91c07cc7a4c0 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:15.542881 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60ffd-11b7-4a22-8f5b-492c92c254fa None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:15.574982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a0704-d420-49f1-94f1-3894299b6d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:15.575792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0704-d420-49f1-94f1-3894299b6d7a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:15.576143 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0704-d420-49f1-94f1-3894299b6d7a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:15.576447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0704-d420-49f1-94f1-3894299b6d7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:15.577612 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a0704-d420-49f1-94f1-3894299b6d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:15.579705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a0704-d420-49f1-94f1-3894299b6d7a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:15.581328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 44/81] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:15.582088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a0704-d420-49f1-94f1-3894299b6d7a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:15.599457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 38/82] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:15.600329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e0337-aab4-443f-9285-91c07cc7a4c0 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:15.673974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a0704-d420-49f1-94f1-3894299b6d7a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:15.696424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e0337-aab4-443f-9285-91c07cc7a4c0 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:15.705335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34a5d-ef08-498c-abde-4a46487bcaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:15.706195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34a5d-ef08-498c-abde-4a46487bcaec None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:15.706478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34a5d-ef08-498c-abde-4a46487bcaec None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:15.706753 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34a5d-ef08-498c-abde-4a46487bcaec None admin] PATH_INFO: `/v3/users/a8842ef81bce467bbeb3e3cf1f632151` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:15.707932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e34a5d-ef08-498c-abde-4a46487bcaec None admin] RBAC: Authorizing `identity:get_user(user_id=a8842ef81bce467bbeb3e3cf1f632151)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:15.709420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e34a5d-ef08-498c-abde-4a46487bcaec None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:15.711889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 45/83] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:15 2022] GET /identity/v3/users/a8842ef81bce467bbeb3e3cf1f632151 => generated 275 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:15.711889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34a5d-ef08-498c-abde-4a46487bcaec None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:15.729165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7296a3-eacf-4052-ba8d-8380bf49f4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:15.729814 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7296a3-eacf-4052-ba8d-8380bf49f4a6 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:15.730094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7296a3-eacf-4052-ba8d-8380bf49f4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:15.730369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7296a3-eacf-4052-ba8d-8380bf49f4a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:15.793401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7296a3-eacf-4052-ba8d-8380bf49f4a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:15.794855 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7296a3-eacf-4052-ba8d-8380bf49f4a6 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:15.804402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34a5d-ef08-498c-abde-4a46487bcaec None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:15.835768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8824b8-cae9-4e4b-ab1a-9bcc38672f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:15.836392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8824b8-cae9-4e4b-ab1a-9bcc38672f71 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:15.836687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8824b8-cae9-4e4b-ab1a-9bcc38672f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:15.836947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8824b8-cae9-4e4b-ab1a-9bcc38672f71 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:15.837683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8824b8-cae9-4e4b-ab1a-9bcc38672f71 None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:15.837992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8824b8-cae9-4e4b-ab1a-9bcc38672f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:15.839378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8824b8-cae9-4e4b-ab1a-9bcc38672f71 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:15.847476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 46/84] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:15.848469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8824b8-cae9-4e4b-ab1a-9bcc38672f71 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:15.895878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 39/85] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:15.896763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7296a3-eacf-4052-ba8d-8380bf49f4a6 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:15.952068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8824b8-cae9-4e4b-ab1a-9bcc38672f71 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:15.983341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3624699-de66-4459-9135-f46a029093e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:15.984009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624699-de66-4459-9135-f46a029093e6 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:15.984347 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624699-de66-4459-9135-f46a029093e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:15.984635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3624699-de66-4459-9135-f46a029093e6 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:15.985940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3624699-de66-4459-9135-f46a029093e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:15.987410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3624699-de66-4459-9135-f46a029093e6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:15.988652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7296a3-eacf-4052-ba8d-8380bf49f4a6 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:16.013268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 47/86] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:52:15 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:16.013268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3624699-de66-4459-9135-f46a029093e6 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:16.024567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aac948-41e8-4e30-b58a-3e3ae98ab4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:16.024567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac948-41e8-4e30-b58a-3e3ae98ab4ef None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:16.024567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac948-41e8-4e30-b58a-3e3ae98ab4ef None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:16.024567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac948-41e8-4e30-b58a-3e3ae98ab4ef None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:16.024842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aac948-41e8-4e30-b58a-3e3ae98ab4ef None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:16.036233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aac948-41e8-4e30-b58a-3e3ae98ab4ef None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:16.036233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 40/87] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:15 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:16.036233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aac948-41e8-4e30-b58a-3e3ae98ab4ef None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:16.120064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3624699-de66-4459-9135-f46a029093e6 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:16.140555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aac948-41e8-4e30-b58a-3e3ae98ab4ef None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:16.155573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b1c46-3cc2-4f43-b4f6-41372e59eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:16.156476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1c46-3cc2-4f43-b4f6-41372e59eb23 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:16.157433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1c46-3cc2-4f43-b4f6-41372e59eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:16.157779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1c46-3cc2-4f43-b4f6-41372e59eb23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:16.176792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fc0ce-faa8-43af-94e2-595f6fc56f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:16.177680 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fc0ce-faa8-43af-94e2-595f6fc56f83 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:16.177969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fc0ce-faa8-43af-94e2-595f6fc56f83 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:16.178249 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fc0ce-faa8-43af-94e2-595f6fc56f83 None admin] PATH_INFO: `/v3/users/a8842ef81bce467bbeb3e3cf1f632151` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:16.179550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fc0ce-faa8-43af-94e2-595f6fc56f83 None admin] RBAC: Authorizing `identity:get_user(user_id=a8842ef81bce467bbeb3e3cf1f632151)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:16.181050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fc0ce-faa8-43af-94e2-595f6fc56f83 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:16.182735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 41/88] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:16 2022] GET /identity/v3/users/a8842ef81bce467bbeb3e3cf1f632151 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:16.185388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fc0ce-faa8-43af-94e2-595f6fc56f83 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:16.228283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b1c46-3cc2-4f43-b4f6-41372e59eb23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:16.229954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b1c46-3cc2-4f43-b4f6-41372e59eb23 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:16.290802 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fc0ce-faa8-43af-94e2-595f6fc56f83 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:16.328537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a031712-0fa6-43d0-92ce-5b0d7bb17b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:16.330017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a031712-0fa6-43d0-92ce-5b0d7bb17b9e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:16.330405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a031712-0fa6-43d0-92ce-5b0d7bb17b9e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:16.330624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a031712-0fa6-43d0-92ce-5b0d7bb17b9e None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:16.331869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a031712-0fa6-43d0-92ce-5b0d7bb17b9e None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:16.332350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 48/89] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:16.332878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b1c46-3cc2-4f43-b4f6-41372e59eb23 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:16.333364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a031712-0fa6-43d0-92ce-5b0d7bb17b9e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:16.335093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 42/90] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:16 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:16.335934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a031712-0fa6-43d0-92ce-5b0d7bb17b9e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:16.433160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b1c46-3cc2-4f43-b4f6-41372e59eb23 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:16.440539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a031712-0fa6-43d0-92ce-5b0d7bb17b9e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:16.468687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4472c-5941-4c28-b6d2-cf98d7f38494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:16.470072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4472c-5941-4c28-b6d2-cf98d7f38494 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:16.470365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4472c-5941-4c28-b6d2-cf98d7f38494 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:16.470637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4472c-5941-4c28-b6d2-cf98d7f38494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:16.471474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4472c-5941-4c28-b6d2-cf98d7f38494 None admin] RBAC: Adding query filter params (role.id=1ead91d8230c468cabd0637c833c42ac, scope.project.id=1da154bbce234bbe9e9dfabe1b861662, user.id=a8842ef81bce467bbeb3e3cf1f632151) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:16.471789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4472c-5941-4c28-b6d2-cf98d7f38494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:16.473309 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4472c-5941-4c28-b6d2-cf98d7f38494 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:16.477138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd52a5-475b-4a91-bc0a-11d29ab0d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:16.477808 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd52a5-475b-4a91-bc0a-11d29ab0d18d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:16.478091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd52a5-475b-4a91-bc0a-11d29ab0d18d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:16.478366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd52a5-475b-4a91-bc0a-11d29ab0d18d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:16.479072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 49/91] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:16 2022] GET /identity/v3/role_assignments?user.id=a8842ef81bce467bbeb3e3cf1f632151&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=1ead91d8230c468cabd0637c833c42ac => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:16.479876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4472c-5941-4c28-b6d2-cf98d7f38494 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:16.591590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4472c-5941-4c28-b6d2-cf98d7f38494 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:16.628959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeb60d-edf1-4ec5-9c09-808434bbe15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:16.629838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb60d-edf1-4ec5-9c09-808434bbe15c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:16.630121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb60d-edf1-4ec5-9c09-808434bbe15c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:16.630394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb60d-edf1-4ec5-9c09-808434bbe15c None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:16.632036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeb60d-edf1-4ec5-9c09-808434bbe15c None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:16.633583 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeb60d-edf1-4ec5-9c09-808434bbe15c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:16.635796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 50/92] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:16 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:16.636632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeb60d-edf1-4ec5-9c09-808434bbe15c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:16.661284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd52a5-475b-4a91-bc0a-11d29ab0d18d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:16.663069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd52a5-475b-4a91-bc0a-11d29ab0d18d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:16.772552 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeb60d-edf1-4ec5-9c09-808434bbe15c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:16.806560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a416c-7008-41f3-8f60-9334b8cfb52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:16.807218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a416c-7008-41f3-8f60-9334b8cfb52d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:16.807504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a416c-7008-41f3-8f60-9334b8cfb52d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:16.807777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a416c-7008-41f3-8f60-9334b8cfb52d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:16.808643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a416c-7008-41f3-8f60-9334b8cfb52d None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=1da154bbce234bbe9e9dfabe1b861662, user.id=f0ae019bc4584bc39f9f7fb0d0af90e6) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:16.808955 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a416c-7008-41f3-8f60-9334b8cfb52d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:16.810657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a416c-7008-41f3-8f60-9334b8cfb52d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:16.816704 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 51/93] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:16 2022] GET /identity/v3/role_assignments?user.id=f0ae019bc4584bc39f9f7fb0d0af90e6&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=3db33dfd3d6544fd81933007633fc56a => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:16.817520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a416c-7008-41f3-8f60-9334b8cfb52d None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:16.867272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 43/94] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:16.873020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd52a5-475b-4a91-bc0a-11d29ab0d18d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:16.975047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a416c-7008-41f3-8f60-9334b8cfb52d None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:17.019828 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289791df-e2ff-4959-a3fb-e95d12d62c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:17.020549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289791df-e2ff-4959-a3fb-e95d12d62c8d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:17.020836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289791df-e2ff-4959-a3fb-e95d12d62c8d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:17.021113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289791df-e2ff-4959-a3fb-e95d12d62c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:17.021965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289791df-e2ff-4959-a3fb-e95d12d62c8d None admin] RBAC: Adding query filter params (role.id=297b3b3e5982438e9af6c05761718fcc, scope.project.id=1da154bbce234bbe9e9dfabe1b861662, user.id=a8842ef81bce467bbeb3e3cf1f632151) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:17.022277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289791df-e2ff-4959-a3fb-e95d12d62c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:17.023796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289791df-e2ff-4959-a3fb-e95d12d62c8d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:17.030005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 52/95] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:16 2022] GET /identity/v3/role_assignments?user.id=a8842ef81bce467bbeb3e3cf1f632151&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=297b3b3e5982438e9af6c05761718fcc => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:17.128785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd52a5-475b-4a91-bc0a-11d29ab0d18d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:17.173098 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721a082-8ca3-4117-9391-ac2014c7ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:17.174334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721a082-8ca3-4117-9391-ac2014c7ab10 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:17.174812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721a082-8ca3-4117-9391-ac2014c7ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:17.175276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721a082-8ca3-4117-9391-ac2014c7ab10 None admin] PATH_INFO: `/v3/projects/cc8114d145884705a409a292ab16323e` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:17.178919 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721a082-8ca3-4117-9391-ac2014c7ab10 None admin] RBAC: Authorizing `identity:get_project(project_id=cc8114d145884705a409a292ab16323e)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:17.180839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721a082-8ca3-4117-9391-ac2014c7ab10 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:17.183269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 44/96] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:16 2022] GET /identity/v3/projects/cc8114d145884705a409a292ab16323e => generated 312 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:17.189530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289791df-e2ff-4959-a3fb-e95d12d62c8d None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:17.321662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289791df-e2ff-4959-a3fb-e95d12d62c8d None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:17.356806 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2e97d-c0ec-4b5f-b6e5-0a5a20179698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:17.357551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2e97d-c0ec-4b5f-b6e5-0a5a20179698 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:17.357737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2e97d-c0ec-4b5f-b6e5-0a5a20179698 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:17.358012 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2e97d-c0ec-4b5f-b6e5-0a5a20179698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:17.358848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2e97d-c0ec-4b5f-b6e5-0a5a20179698 None admin] RBAC: Adding query filter params (role.id=1ead91d8230c468cabd0637c833c42ac, scope.project.id=cc8114d145884705a409a292ab16323e, user.id=a8842ef81bce467bbeb3e3cf1f632151) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:17.359163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2e97d-c0ec-4b5f-b6e5-0a5a20179698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:17.361164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2e97d-c0ec-4b5f-b6e5-0a5a20179698 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:17.367222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 53/97] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:17 2022] GET /identity/v3/role_assignments?user.id=a8842ef81bce467bbeb3e3cf1f632151&scope.project.id=cc8114d145884705a409a292ab16323e&role.id=1ead91d8230c468cabd0637c833c42ac => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:18.861672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c4fa-5836-460b-8abe-c9ff86939740 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:18.862673 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c4fa-5836-460b-8abe-c9ff86939740 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:18.863161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7c4fa-5836-460b-8abe-c9ff86939740 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:18.864793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 45/98] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:18.874084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0965357-cde6-4e9a-8e9c-84bd7f4ce46b None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:18.874520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0965357-cde6-4e9a-8e9c-84bd7f4ce46b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:18.874716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0965357-cde6-4e9a-8e9c-84bd7f4ce46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:18.898178 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f0965357-cde6-4e9a-8e9c-84bd7f4ce46b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:18.899349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f0965357-cde6-4e9a-8e9c-84bd7f4ce46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:18.970456 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 54/99] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:19.018036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7c4fa-5836-460b-8abe-c9ff86939740 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:19.038180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca79213-a98d-4f4f-926b-b43691451016 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:19.038619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca79213-a98d-4f4f-926b-b43691451016 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:19.039003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca79213-a98d-4f4f-926b-b43691451016 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:19.040784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 55/100] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:19.045650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbdeb1-2d54-4180-93c8-168c8de0fcbc None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:19.046042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbdeb1-2d54-4180-93c8-168c8de0fcbc None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:19.046423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbdeb1-2d54-4180-93c8-168c8de0fcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:19.064341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-32bbdeb1-2d54-4180-93c8-168c8de0fcbc None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:19.065621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-32bbdeb1-2d54-4180-93c8-168c8de0fcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:19.137204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 56/101] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:19.161997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbdeb1-2d54-4180-93c8-168c8de0fcbc None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:19.201986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7c4fa-5836-460b-8abe-c9ff86939740 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:19.258849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aa0b0-a816-43b7-ad44-338e89bf6368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:19.259668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aa0b0-a816-43b7-ad44-338e89bf6368 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:19.259957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aa0b0-a816-43b7-ad44-338e89bf6368 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:19.260261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19aa0b0-a816-43b7-ad44-338e89bf6368 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:19.262423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aa0b0-a816-43b7-ad44-338e89bf6368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:19.263898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19aa0b0-a816-43b7-ad44-338e89bf6368 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:19.265565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 46/102] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:19.271884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aa0b0-a816-43b7-ad44-338e89bf6368 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:19.277960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbdeb1-2d54-4180-93c8-168c8de0fcbc None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:19.317912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6955-7099-4707-9d8f-9275df5e018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:19.318722 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6955-7099-4707-9d8f-9275df5e018f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:19.319016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6955-7099-4707-9d8f-9275df5e018f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:19.319299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f6955-7099-4707-9d8f-9275df5e018f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:19.331282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f6955-7099-4707-9d8f-9275df5e018f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-521f6955-7099-4707-9d8f-9275df5e018f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:19.339331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:19.340210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:19.341495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 57/103] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:19.347310 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6955-7099-4707-9d8f-9275df5e018f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:19.451001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19aa0b0-a816-43b7-ad44-338e89bf6368 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:19.453017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f6955-7099-4707-9d8f-9275df5e018f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:19.493116 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bcf2b-41ee-4cf5-a8a4-dd857406dfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:19.493792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bcf2b-41ee-4cf5-a8a4-dd857406dfc6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:19.494076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bcf2b-41ee-4cf5-a8a4-dd857406dfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:19.494353 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bcf2b-41ee-4cf5-a8a4-dd857406dfc6 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:19.495104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bcf2b-41ee-4cf5-a8a4-dd857406dfc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:19.495412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bcf2b-41ee-4cf5-a8a4-dd857406dfc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:19.496849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bcf2b-41ee-4cf5-a8a4-dd857406dfc6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:19.506007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 58/104] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:19.511409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bcf2b-41ee-4cf5-a8a4-dd857406dfc6 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:19.511714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd8169-23e7-48ff-a760-147617809d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:19.512423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8169-23e7-48ff-a760-147617809d87 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:19.512719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8169-23e7-48ff-a760-147617809d87 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:19.513000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8169-23e7-48ff-a760-147617809d87 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:19.513724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd8169-23e7-48ff-a760-147617809d87 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:19.515191 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd8169-23e7-48ff-a760-147617809d87 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:19.578191 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 47/105] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:52:19 2022] POST /identity/v3/projects => generated 302 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:19.622368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bcf2b-41ee-4cf5-a8a4-dd857406dfc6 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:19.658539 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cdce4-c5ff-4337-9c5a-98482bbf9e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:19.659421 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cdce4-c5ff-4337-9c5a-98482bbf9e16 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:19.659707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cdce4-c5ff-4337-9c5a-98482bbf9e16 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:19.659982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cdce4-c5ff-4337-9c5a-98482bbf9e16 None admin] PATH_INFO: `/v3/users/0b3801c5fdcb4483b752e852febd230e` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:19.674645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cdce4-c5ff-4337-9c5a-98482bbf9e16 None admin] RBAC: Authorizing `identity:get_user(user_id=0b3801c5fdcb4483b752e852febd230e)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:19.676123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cdce4-c5ff-4337-9c5a-98482bbf9e16 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:19.678243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 59/106] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:19 2022] GET /identity/v3/users/0b3801c5fdcb4483b752e852febd230e => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:19.683702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd8169-23e7-48ff-a760-147617809d87 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:19.814909 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972051f-2189-4aca-b424-6ee22e7fb7b0 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:19.815454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972051f-2189-4aca-b424-6ee22e7fb7b0 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:19.815940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972051f-2189-4aca-b424-6ee22e7fb7b0 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:19.819988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 60/107] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:19.822811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd8169-23e7-48ff-a760-147617809d87 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:19.827517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f00d6-df1b-4e88-8353-2cf25ac6c141 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:19.828017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f00d6-df1b-4e88-8353-2cf25ac6c141 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:19.828660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f00d6-df1b-4e88-8353-2cf25ac6c141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:19.876638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd658904-b1f7-4ec2-992f-16300b4d1539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:19.877314 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658904-b1f7-4ec2-992f-16300b4d1539 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:19.877601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658904-b1f7-4ec2-992f-16300b4d1539 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:19.877880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658904-b1f7-4ec2-992f-16300b4d1539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:19.879277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f80f00d6-df1b-4e88-8353-2cf25ac6c141 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:19.880505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f80f00d6-df1b-4e88-8353-2cf25ac6c141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:19.990233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd658904-b1f7-4ec2-992f-16300b4d1539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:19.991987 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd658904-b1f7-4ec2-992f-16300b4d1539 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:20.022724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 61/108] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:20.095159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f00d6-df1b-4e88-8353-2cf25ac6c141 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:20.106308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 48/109] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:20.112649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd658904-b1f7-4ec2-992f-16300b4d1539 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:20.211674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd658904-b1f7-4ec2-992f-16300b4d1539 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:20.251534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515dbe0-4f91-4f7c-9444-60f6abbb7963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:20.252724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515dbe0-4f91-4f7c-9444-60f6abbb7963 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:20.254571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515dbe0-4f91-4f7c-9444-60f6abbb7963 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:20.255049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515dbe0-4f91-4f7c-9444-60f6abbb7963 None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:20.257205 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515dbe0-4f91-4f7c-9444-60f6abbb7963 None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:20.259592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515dbe0-4f91-4f7c-9444-60f6abbb7963 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:20.261671 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 49/110] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:20 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:20.269668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515dbe0-4f91-4f7c-9444-60f6abbb7963 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:20.298346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f00d6-df1b-4e88-8353-2cf25ac6c141 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:20.378302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29de5a3-b17f-4cbc-acaf-f25df5134036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:20.379138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de5a3-b17f-4cbc-acaf-f25df5134036 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:20.379490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de5a3-b17f-4cbc-acaf-f25df5134036 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:20.380196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29de5a3-b17f-4cbc-acaf-f25df5134036 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:20.413179 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29de5a3-b17f-4cbc-acaf-f25df5134036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:20.414679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515dbe0-4f91-4f7c-9444-60f6abbb7963 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-f29de5a3-b17f-4cbc-acaf-f25df5134036 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:20.421373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:20.422852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:20.423691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 62/111] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:20.433315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29de5a3-b17f-4cbc-acaf-f25df5134036 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:20.462604 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140040e-e069-401f-9b09-e913993049f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:20.463565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140040e-e069-401f-9b09-e913993049f9 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:20.464917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140040e-e069-401f-9b09-e913993049f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:20.465204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140040e-e069-401f-9b09-e913993049f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:20.466077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140040e-e069-401f-9b09-e913993049f9 None admin] RBAC: Adding query filter params (role.id=771bd64f51c4466a934ee622fea6214f, scope.project.id=1da154bbce234bbe9e9dfabe1b861662, user.id=0b3801c5fdcb4483b752e852febd230e) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:20.466396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140040e-e069-401f-9b09-e913993049f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:20.467861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140040e-e069-401f-9b09-e913993049f9 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:20.475196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 50/112] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:20 2022] GET /identity/v3/role_assignments?user.id=0b3801c5fdcb4483b752e852febd230e&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=771bd64f51c4466a934ee622fea6214f => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:20.621385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29de5a3-b17f-4cbc-acaf-f25df5134036 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:20.674263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d7bc5-a5a9-4ef7-ac93-ec2e4c2f8bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:20.674971 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7bc5-a5a9-4ef7-ac93-ec2e4c2f8bdb None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:20.675259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7bc5-a5a9-4ef7-ac93-ec2e4c2f8bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:20.675541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7bc5-a5a9-4ef7-ac93-ec2e4c2f8bdb None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:20.676342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d7bc5-a5a9-4ef7-ac93-ec2e4c2f8bdb None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:20.676658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d7bc5-a5a9-4ef7-ac93-ec2e4c2f8bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:20.678132 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d7bc5-a5a9-4ef7-ac93-ec2e4c2f8bdb None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:20.692857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 63/113] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:20.698315 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140040e-e069-401f-9b09-e913993049f9 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:20.718667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46f987-e966-4f82-8e30-5e2c775a331e None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:20.718982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46f987-e966-4f82-8e30-5e2c775a331e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:20.719456 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46f987-e966-4f82-8e30-5e2c775a331e None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:20.721381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 64/114] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:20.727154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0339a3-2af5-4a3f-8363-baffaebc757a None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:20.727440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0339a3-2af5-4a3f-8363-baffaebc757a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:20.727723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0339a3-2af5-4a3f-8363-baffaebc757a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:20.745265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-8e0339a3-2af5-4a3f-8363-baffaebc757a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:20.746449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-8e0339a3-2af5-4a3f-8363-baffaebc757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:20.819599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 65/115] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:20.825627 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b687ed-4739-4a9a-9323-d90b02423296 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:20.825924 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b687ed-4739-4a9a-9323-d90b02423296 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:20.826257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b687ed-4739-4a9a-9323-d90b02423296 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:20.827789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 66/116] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:20.830288 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140040e-e069-401f-9b09-e913993049f9 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:20.833438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6ac94-af98-459f-a0be-4a2dbf15693f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:20.833733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6ac94-af98-459f-a0be-4a2dbf15693f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:20.834018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6ac94-af98-459f-a0be-4a2dbf15693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:20.858652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2dd6ac94-af98-459f-a0be-4a2dbf15693f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:20.859987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2dd6ac94-af98-459f-a0be-4a2dbf15693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:20.872051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1c37-c3fd-4d73-bafb-90f67015a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:20.873219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1c37-c3fd-4d73-bafb-90f67015a897 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:20.873695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1c37-c3fd-4d73-bafb-90f67015a897 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:20.873981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a1c37-c3fd-4d73-bafb-90f67015a897 None admin] PATH_INFO: `/v3/users/a8842ef81bce467bbeb3e3cf1f632151` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:20.875217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a1c37-c3fd-4d73-bafb-90f67015a897 None admin] RBAC: Authorizing `identity:get_user(user_id=a8842ef81bce467bbeb3e3cf1f632151)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:20.877340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a1c37-c3fd-4d73-bafb-90f67015a897 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:20.879069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 51/117] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:20 2022] GET /identity/v3/users/a8842ef81bce467bbeb3e3cf1f632151 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:20.879913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1c37-c3fd-4d73-bafb-90f67015a897 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:20.938398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 67/118] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:20.939922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6ac94-af98-459f-a0be-4a2dbf15693f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:21.007825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a1c37-c3fd-4d73-bafb-90f67015a897 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:21.039447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6ac94-af98-459f-a0be-4a2dbf15693f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:21.056230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9781f7-7747-40bf-818d-93346f396a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:21.057478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9781f7-7747-40bf-818d-93346f396a44 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.057906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9781f7-7747-40bf-818d-93346f396a44 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.058316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9781f7-7747-40bf-818d-93346f396a44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.073133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9781f7-7747-40bf-818d-93346f396a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:21.076498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd55251-77af-412a-81fc-8ddc9a86703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:21.077588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd55251-77af-412a-81fc-8ddc9a86703a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.078067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd55251-77af-412a-81fc-8ddc9a86703a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.078605 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd55251-77af-412a-81fc-8ddc9a86703a None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.080009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd55251-77af-412a-81fc-8ddc9a86703a None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:21.081716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd55251-77af-412a-81fc-8ddc9a86703a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:21.083646 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 68/119] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:20 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:21.084658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd55251-77af-412a-81fc-8ddc9a86703a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-8d9781f7-7747-40bf-818d-93346f396a44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:21.086040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:21.086844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:21.087613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 52/120] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:52:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:21.093617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eb85a-544f-4a38-8b4c-e16f99eb1ea3 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.093928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eb85a-544f-4a38-8b4c-e16f99eb1ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.094266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eb85a-544f-4a38-8b4c-e16f99eb1ea3 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.095710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 53/121] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:21.096727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6eb85a-544f-4a38-8b4c-e16f99eb1ea3 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:21.189831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd55251-77af-412a-81fc-8ddc9a86703a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:21.201890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6eb85a-544f-4a38-8b4c-e16f99eb1ea3 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:21.226148 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a155efc-d009-468d-ad0e-a251ba1f0d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:21.227288 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a155efc-d009-468d-ad0e-a251ba1f0d7c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.227767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a155efc-d009-468d-ad0e-a251ba1f0d7c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.228265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a155efc-d009-468d-ad0e-a251ba1f0d7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.238857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8962b-1bbc-4318-b242-2627c65674ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:21.239807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8962b-1bbc-4318-b242-2627c65674ef None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.240135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8962b-1bbc-4318-b242-2627c65674ef None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.240440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8962b-1bbc-4318-b242-2627c65674ef None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662/users/a8842ef81bce467bbeb3e3cf1f632151/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.241297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a155efc-d009-468d-ad0e-a251ba1f0d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:21.242588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8962b-1bbc-4318-b242-2627c65674ef None admin] RBAC: Authorizing `identity:create_grant(project_id=1da154bbce234bbe9e9dfabe1b861662, user_id=a8842ef81bce467bbeb3e3cf1f632151, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:21.244149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8962b-1bbc-4318-b242-2627c65674ef None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-1a155efc-d009-468d-ad0e-a251ba1f0d7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:21.250176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:21.252080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:21.253159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 69/122] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:52:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:21.256362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a155efc-d009-468d-ad0e-a251ba1f0d7c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:21.268622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 54/123] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:52:21 2022] PUT /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662/users/a8842ef81bce467bbeb3e3cf1f632151/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:21.270238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5321c2-d0fd-421f-b064-8ad43d6d568a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.270623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5321c2-d0fd-421f-b064-8ad43d6d568a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.271397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5321c2-d0fd-421f-b064-8ad43d6d568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.305495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ca5321c2-d0fd-421f-b064-8ad43d6d568a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:21.306888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ca5321c2-d0fd-421f-b064-8ad43d6d568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:21.377664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a155efc-d009-468d-ad0e-a251ba1f0d7c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:21.423818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45f28a-596f-4eb5-b976-7b1f4bc7cbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:21.424862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45f28a-596f-4eb5-b976-7b1f4bc7cbea None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.425562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45f28a-596f-4eb5-b976-7b1f4bc7cbea None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.426631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45f28a-596f-4eb5-b976-7b1f4bc7cbea None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.428354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45f28a-596f-4eb5-b976-7b1f4bc7cbea None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:21.430749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45f28a-596f-4eb5-b976-7b1f4bc7cbea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:21.432452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45f28a-596f-4eb5-b976-7b1f4bc7cbea None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:21.448005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 70/124] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:21.450575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45f28a-596f-4eb5-b976-7b1f4bc7cbea None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:21.464683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 55/125] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:21.465797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5321c2-d0fd-421f-b064-8ad43d6d568a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:21.590538 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45f28a-596f-4eb5-b976-7b1f4bc7cbea None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:21.624078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc656-d7df-481f-b8ca-a604a301a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:21.624783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc656-d7df-481f-b8ca-a604a301a93f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.628201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc656-d7df-481f-b8ca-a604a301a93f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.628201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc656-d7df-481f-b8ca-a604a301a93f None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.628201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc656-d7df-481f-b8ca-a604a301a93f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:21.628201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc656-d7df-481f-b8ca-a604a301a93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:21.628563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc656-d7df-481f-b8ca-a604a301a93f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:21.630748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5321c2-d0fd-421f-b064-8ad43d6d568a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:21.636626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 71/126] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:52:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:21.637281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc656-d7df-481f-b8ca-a604a301a93f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:21.694569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c8b7e-e7c8-4ca3-a796-a41e7cd67497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:21.695467 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8b7e-e7c8-4ca3-a796-a41e7cd67497 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.695751 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8b7e-e7c8-4ca3-a796-a41e7cd67497 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.696030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8b7e-e7c8-4ca3-a796-a41e7cd67497 None admin] PATH_INFO: `/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.701031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c8b7e-e7c8-4ca3-a796-a41e7cd67497 None admin] RBAC: Authorizing `identity:get_user(user_id=f0ae019bc4584bc39f9f7fb0d0af90e6)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:21.702914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c8b7e-e7c8-4ca3-a796-a41e7cd67497 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:21.707112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 56/127] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:21 2022] GET /identity/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6 => generated 247 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:21.707993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c8b7e-e7c8-4ca3-a796-a41e7cd67497 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:21.737548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc656-d7df-481f-b8ca-a604a301a93f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:21.773191 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12362f5-962c-49b9-9ec2-445a5b43a4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:21.773988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12362f5-962c-49b9-9ec2-445a5b43a4d5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.774268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12362f5-962c-49b9-9ec2-445a5b43a4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.774547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12362f5-962c-49b9-9ec2-445a5b43a4d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.784974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12362f5-962c-49b9-9ec2-445a5b43a4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-b12362f5-962c-49b9-9ec2-445a5b43a4d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:21.792731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:21.793619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:21.794382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 72/128] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:21.795036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12362f5-962c-49b9-9ec2-445a5b43a4d5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:21.899793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12362f5-962c-49b9-9ec2-445a5b43a4d5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:21.910423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c8b7e-e7c8-4ca3-a796-a41e7cd67497 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:21.939252 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c1562-e9e3-42b4-8330-cee83bb4a4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:21.940120 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c1562-e9e3-42b4-8330-cee83bb4a4f7 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.940433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c1562-e9e3-42b4-8330-cee83bb4a4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.940711 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c1562-e9e3-42b4-8330-cee83bb4a4f7 None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.943255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c1562-e9e3-42b4-8330-cee83bb4a4f7 None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:21.944750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c1562-e9e3-42b4-8330-cee83bb4a4f7 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:21.946592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 73/129] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:21 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:21.947182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c1562-e9e3-42b4-8330-cee83bb4a4f7 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:21.981568 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a70dbc-3aa0-45f5-a621-dda425d0caa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:21.982362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a70dbc-3aa0-45f5-a621-dda425d0caa3 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:21.982640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a70dbc-3aa0-45f5-a621-dda425d0caa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:21.982908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a70dbc-3aa0-45f5-a621-dda425d0caa3 None admin] PATH_INFO: `/v3/users/a8842ef81bce467bbeb3e3cf1f632151` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:21.985709 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a70dbc-3aa0-45f5-a621-dda425d0caa3 None admin] RBAC: Authorizing `identity:get_user(user_id=a8842ef81bce467bbeb3e3cf1f632151)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:21.987175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a70dbc-3aa0-45f5-a621-dda425d0caa3 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:21.988832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 57/130] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:21 2022] GET /identity/v3/users/a8842ef81bce467bbeb3e3cf1f632151 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:21.994140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a70dbc-3aa0-45f5-a621-dda425d0caa3 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:22.079681 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c1562-e9e3-42b4-8330-cee83bb4a4f7 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:22.112972 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59098f3-ed86-4640-863b-a74e0524621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:22.113662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59098f3-ed86-4640-863b-a74e0524621a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:22.113946 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59098f3-ed86-4640-863b-a74e0524621a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:22.114223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59098f3-ed86-4640-863b-a74e0524621a None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:22.114990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59098f3-ed86-4640-863b-a74e0524621a None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:22.115305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59098f3-ed86-4640-863b-a74e0524621a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:22.116752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59098f3-ed86-4640-863b-a74e0524621a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:22.125949 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 74/131] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:22.126775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59098f3-ed86-4640-863b-a74e0524621a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:22.138317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a70dbc-3aa0-45f5-a621-dda425d0caa3 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:22.182259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7718a7-b74f-4828-ba57-48683cef852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:22.183161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7718a7-b74f-4828-ba57-48683cef852e None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:22.183452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7718a7-b74f-4828-ba57-48683cef852e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:22.183736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7718a7-b74f-4828-ba57-48683cef852e None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662/users/f0ae019bc4584bc39f9f7fb0d0af90e6/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:22.190112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7718a7-b74f-4828-ba57-48683cef852e None admin] RBAC: Authorizing `identity:create_grant(project_id=1da154bbce234bbe9e9dfabe1b861662, user_id=f0ae019bc4584bc39f9f7fb0d0af90e6, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:22.191581 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7718a7-b74f-4828-ba57-48683cef852e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:22.226430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 58/132] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:52:21 2022] PUT /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662/users/f0ae019bc4584bc39f9f7fb0d0af90e6/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:22.227061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7718a7-b74f-4828-ba57-48683cef852e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:22.231735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59098f3-ed86-4640-863b-a74e0524621a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:22.267739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dc787-afdc-48c3-abae-c417f5a76678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:22.268837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc787-afdc-48c3-abae-c417f5a76678 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:22.269125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc787-afdc-48c3-abae-c417f5a76678 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:22.269401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc787-afdc-48c3-abae-c417f5a76678 None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:22.270720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dc787-afdc-48c3-abae-c417f5a76678 None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:22.272239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dc787-afdc-48c3-abae-c417f5a76678 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:22.274650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 75/133] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:22 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:22.280974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dc787-afdc-48c3-abae-c417f5a76678 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:22.397411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dc787-afdc-48c3-abae-c417f5a76678 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:22.436517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35dc73-337a-42ad-a7bd-e64feedbb288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:22.437428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35dc73-337a-42ad-a7bd-e64feedbb288 None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:22.438329 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35dc73-337a-42ad-a7bd-e64feedbb288 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:22.438637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35dc73-337a-42ad-a7bd-e64feedbb288 None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662/users/a8842ef81bce467bbeb3e3cf1f632151/roles/297b3b3e5982438e9af6c05761718fcc` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:22.441555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35dc73-337a-42ad-a7bd-e64feedbb288 None admin] RBAC: Authorizing `identity:create_grant(project_id=1da154bbce234bbe9e9dfabe1b861662, user_id=a8842ef81bce467bbeb3e3cf1f632151, role_id=297b3b3e5982438e9af6c05761718fcc)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:22.443057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35dc73-337a-42ad-a7bd-e64feedbb288 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:22.471778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 76/134] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:52:22 2022] PUT /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662/users/a8842ef81bce467bbeb3e3cf1f632151/roles/297b3b3e5982438e9af6c05761718fcc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:22.494042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7718a7-b74f-4828-ba57-48683cef852e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:22.559476 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3f180-8361-4fbf-8358-234ff4050ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:22.561008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f180-8361-4fbf-8358-234ff4050ad5 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:22.561508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f180-8361-4fbf-8358-234ff4050ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:22.561974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f180-8361-4fbf-8358-234ff4050ad5 None admin] PATH_INFO: `/v3/users/a8842ef81bce467bbeb3e3cf1f632151` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:22.563556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3f180-8361-4fbf-8358-234ff4050ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=a8842ef81bce467bbeb3e3cf1f632151)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:22.565471 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3f180-8361-4fbf-8358-234ff4050ad5 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:22.567757 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 59/135] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:22 2022] GET /identity/v3/users/a8842ef81bce467bbeb3e3cf1f632151 => generated 275 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:22.572936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35dc73-337a-42ad-a7bd-e64feedbb288 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:22.743414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35dc73-337a-42ad-a7bd-e64feedbb288 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:22.780751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7bbbe-5286-4408-9c19-a939581bbd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:22.782119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7bbbe-5286-4408-9c19-a939581bbd26 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:22.782438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7bbbe-5286-4408-9c19-a939581bbd26 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:22.782707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7bbbe-5286-4408-9c19-a939581bbd26 None admin] PATH_INFO: `/v3/projects/cc8114d145884705a409a292ab16323e` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:22.783988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7bbbe-5286-4408-9c19-a939581bbd26 None admin] RBAC: Authorizing `identity:get_project(project_id=cc8114d145884705a409a292ab16323e)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:22.785527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7bbbe-5286-4408-9c19-a939581bbd26 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:22.787593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 77/136] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:22 2022] GET /identity/v3/projects/cc8114d145884705a409a292ab16323e => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:22.793369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3f180-8361-4fbf-8358-234ff4050ad5 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:22.903812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3f180-8361-4fbf-8358-234ff4050ad5 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:22.941014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f0b06-8683-4529-9fb8-5f40aca523ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:22.941935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f0b06-8683-4529-9fb8-5f40aca523ad None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:22.942221 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f0b06-8683-4529-9fb8-5f40aca523ad None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:22.942501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f0b06-8683-4529-9fb8-5f40aca523ad None admin] PATH_INFO: `/v3/projects/cc8114d145884705a409a292ab16323e/users/a8842ef81bce467bbeb3e3cf1f632151/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:22.944672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f0b06-8683-4529-9fb8-5f40aca523ad None admin] RBAC: Authorizing `identity:create_grant(project_id=cc8114d145884705a409a292ab16323e, user_id=a8842ef81bce467bbeb3e3cf1f632151, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:22.946192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f0b06-8683-4529-9fb8-5f40aca523ad None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:22.965673 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 60/137] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:52:22 2022] PUT /identity/v3/projects/cc8114d145884705a409a292ab16323e/users/a8842ef81bce467bbeb3e3cf1f632151/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:23.378279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953df76-fec2-4092-a064-51d9c9884431 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:23.378986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953df76-fec2-4092-a064-51d9c9884431 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:23.378986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953df76-fec2-4092-a064-51d9c9884431 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:23.380419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 78/138] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:23.385848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22136-bbd1-41ec-a8c3-e15ba3890ec3 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:23.386144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22136-bbd1-41ec-a8c3-e15ba3890ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:23.386426 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22136-bbd1-41ec-a8c3-e15ba3890ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:23.406477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-bbe22136-bbd1-41ec-a8c3-e15ba3890ec3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:23.407746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-bbe22136-bbd1-41ec-a8c3-e15ba3890ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:23.489870 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 61/139] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:23.549546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953df76-fec2-4092-a064-51d9c9884431 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:23.693159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953df76-fec2-4092-a064-51d9c9884431 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:23.738238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c5de1-8a9b-4d40-99a2-1ab5da52daf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:23.739038 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c5de1-8a9b-4d40-99a2-1ab5da52daf8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:23.739319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c5de1-8a9b-4d40-99a2-1ab5da52daf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:23.739597 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c5de1-8a9b-4d40-99a2-1ab5da52daf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:23.740806 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c5de1-8a9b-4d40-99a2-1ab5da52daf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:23.742279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c5de1-8a9b-4d40-99a2-1ab5da52daf8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:23.743884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 79/140] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:23.749450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe22136-bbd1-41ec-a8c3-e15ba3890ec3 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:23.883514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe22136-bbd1-41ec-a8c3-e15ba3890ec3 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:23.917594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45157344-939a-4434-8a4a-d01625c58592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:23.918278 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45157344-939a-4434-8a4a-d01625c58592 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:23.918562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45157344-939a-4434-8a4a-d01625c58592 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:23.918835 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45157344-939a-4434-8a4a-d01625c58592 None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:23.919554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45157344-939a-4434-8a4a-d01625c58592 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:23.921044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45157344-939a-4434-8a4a-d01625c58592 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:23.946178 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 62/141] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:52:23 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:23.961683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731168c-768b-4c95-be96-75cc7fdf0d70 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:23.961985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731168c-768b-4c95-be96-75cc7fdf0d70 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:23.962250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731168c-768b-4c95-be96-75cc7fdf0d70 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:23.963659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 80/142] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:23.969650 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89706d91-a9e5-4316-bf76-3620404f664c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:23.970001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89706d91-a9e5-4316-bf76-3620404f664c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:23.970297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89706d91-a9e5-4316-bf76-3620404f664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:23.992240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-89706d91-a9e5-4316-bf76-3620404f664c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:23.993525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-89706d91-a9e5-4316-bf76-3620404f664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:24.086795 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 63/143] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:24.125510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731168c-768b-4c95-be96-75cc7fdf0d70 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:24.264305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731168c-768b-4c95-be96-75cc7fdf0d70 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:24.312235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e69a0-8f15-4fa9-b098-e3f8415ed70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:24.314028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e69a0-8f15-4fa9-b098-e3f8415ed70a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:24.314518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e69a0-8f15-4fa9-b098-e3f8415ed70a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:24.315005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e69a0-8f15-4fa9-b098-e3f8415ed70a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:24.333185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e69a0-8f15-4fa9-b098-e3f8415ed70a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-272e69a0-8f15-4fa9-b098-e3f8415ed70a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:24.340936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:24.341775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:24.342529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 81/144] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:24.348742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89706d91-a9e5-4316-bf76-3620404f664c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:24.428576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ea37b-6de5-46ec-8fa5-4d468a21aa43 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:24.429094 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ea37b-6de5-46ec-8fa5-4d468a21aa43 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:24.429176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ea37b-6de5-46ec-8fa5-4d468a21aa43 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:24.430525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 82/145] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:24.452905 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cced7d-59d6-45df-b028-f3797adb66dc None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:24.453239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cced7d-59d6-45df-b028-f3797adb66dc None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:24.454250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cced7d-59d6-45df-b028-f3797adb66dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:24.470540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89706d91-a9e5-4316-bf76-3620404f664c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:24.489172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-91cced7d-59d6-45df-b028-f3797adb66dc None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:24.490366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-91cced7d-59d6-45df-b028-f3797adb66dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:24.507248 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f8cde-dda8-4128-bcaf-984101258ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:24.508326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f8cde-dda8-4128-bcaf-984101258ade None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:24.508832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f8cde-dda8-4128-bcaf-984101258ade None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:24.509329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f8cde-dda8-4128-bcaf-984101258ade None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:24.510309 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f8cde-dda8-4128-bcaf-984101258ade None admin] RBAC: Adding query filter params (name=reader) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:24.510845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f8cde-dda8-4128-bcaf-984101258ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:24.512538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f8cde-dda8-4128-bcaf-984101258ade None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:24.529403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 64/146] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:24.539555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f8cde-dda8-4128-bcaf-984101258ade None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:24.608546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 83/147] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:24.646299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cced7d-59d6-45df-b028-f3797adb66dc None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:24.648071 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f8cde-dda8-4128-bcaf-984101258ade None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:24.691057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc104a-2f05-4868-8912-813d4f809884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:24.692315 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc104a-2f05-4868-8912-813d4f809884 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:24.692868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc104a-2f05-4868-8912-813d4f809884 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:24.693346 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc104a-2f05-4868-8912-813d4f809884 None admin] PATH_INFO: `/v3/users/0b3801c5fdcb4483b752e852febd230e` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:24.694831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc104a-2f05-4868-8912-813d4f809884 None admin] RBAC: Authorizing `identity:get_user(user_id=0b3801c5fdcb4483b752e852febd230e)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:24.696677 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc104a-2f05-4868-8912-813d4f809884 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:24.698531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 65/148] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:24 2022] GET /identity/v3/users/0b3801c5fdcb4483b752e852febd230e => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:24.704510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc104a-2f05-4868-8912-813d4f809884 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:24.759229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cced7d-59d6-45df-b028-f3797adb66dc None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:24.796964 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a19f8b-7150-4113-a041-3622e6d81977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:24.798135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a19f8b-7150-4113-a041-3622e6d81977 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:24.798361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a19f8b-7150-4113-a041-3622e6d81977 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:24.798764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a19f8b-7150-4113-a041-3622e6d81977 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:24.810197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a19f8b-7150-4113-a041-3622e6d81977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-80a19f8b-7150-4113-a041-3622e6d81977 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:24.819035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:24.820405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:24.822369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 84/149] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:24.826215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a19f8b-7150-4113-a041-3622e6d81977 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:24.840101 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc104a-2f05-4868-8912-813d4f809884 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:24.877619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78452b4-da83-4261-84ee-c7b0990c3368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:24.878839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78452b4-da83-4261-84ee-c7b0990c3368 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:24.879319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78452b4-da83-4261-84ee-c7b0990c3368 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:24.879787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78452b4-da83-4261-84ee-c7b0990c3368 None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:24.881240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78452b4-da83-4261-84ee-c7b0990c3368 None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:24.883017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78452b4-da83-4261-84ee-c7b0990c3368 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:24.884970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 66/150] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:24 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:24.893229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78452b4-da83-4261-84ee-c7b0990c3368 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:24.931453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a19f8b-7150-4113-a041-3622e6d81977 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:24.977487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c6591-7430-4939-bb43-fe483732a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:24.978182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6591-7430-4939-bb43-fe483732a81f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:24.978466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6591-7430-4939-bb43-fe483732a81f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:24.978743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6591-7430-4939-bb43-fe483732a81f None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:24.979509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6591-7430-4939-bb43-fe483732a81f None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:24.979820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6591-7430-4939-bb43-fe483732a81f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:24.981260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6591-7430-4939-bb43-fe483732a81f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:24.995059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 85/151] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:25.001877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c6591-7430-4939-bb43-fe483732a81f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:25.079899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78452b4-da83-4261-84ee-c7b0990c3368 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:25.153204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adf6e7-31f6-489d-88be-7e184f3fe30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:25.155244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf6e7-31f6-489d-88be-7e184f3fe30c None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:25.156080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf6e7-31f6-489d-88be-7e184f3fe30c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:25.158095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf6e7-31f6-489d-88be-7e184f3fe30c None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662/users/0b3801c5fdcb4483b752e852febd230e/roles/771bd64f51c4466a934ee622fea6214f` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:25.165474 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17adf6e7-31f6-489d-88be-7e184f3fe30c None admin] RBAC: Authorizing `identity:create_grant(project_id=1da154bbce234bbe9e9dfabe1b861662, user_id=0b3801c5fdcb4483b752e852febd230e, role_id=771bd64f51c4466a934ee622fea6214f)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:25.169938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17adf6e7-31f6-489d-88be-7e184f3fe30c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:25.192349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 67/152] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:52:24 2022] PUT /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662/users/0b3801c5fdcb4483b752e852febd230e/roles/771bd64f51c4466a934ee622fea6214f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:25.197300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c6591-7430-4939-bb43-fe483732a81f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:25.237227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b33781-a73f-4ac9-940c-f40c2e5fbcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:25.238562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33781-a73f-4ac9-940c-f40c2e5fbcb4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:25.239035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33781-a73f-4ac9-940c-f40c2e5fbcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:25.239503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33781-a73f-4ac9-940c-f40c2e5fbcb4 None admin] PATH_INFO: `/v3/users/a8842ef81bce467bbeb3e3cf1f632151` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:25.242746 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b33781-a73f-4ac9-940c-f40c2e5fbcb4 None admin] RBAC: Authorizing `identity:get_user(user_id=a8842ef81bce467bbeb3e3cf1f632151)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:25.244562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b33781-a73f-4ac9-940c-f40c2e5fbcb4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:25.246676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 86/153] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:24 2022] GET /identity/v3/users/a8842ef81bce467bbeb3e3cf1f632151 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:25.252896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adf6e7-31f6-489d-88be-7e184f3fe30c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:25.372267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adf6e7-31f6-489d-88be-7e184f3fe30c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:25.418454 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c236-bf51-499f-86a4-1b84733cb60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:25.419494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c236-bf51-499f-86a4-1b84733cb60a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:25.420122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c236-bf51-499f-86a4-1b84733cb60a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:25.420621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c236-bf51-499f-86a4-1b84733cb60a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:25.501551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3c236-bf51-499f-86a4-1b84733cb60a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:25.503357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3c236-bf51-499f-86a4-1b84733cb60a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:25.627584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 68/154] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:25.633039 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b33781-a73f-4ac9-940c-f40c2e5fbcb4 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:25.741647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b33781-a73f-4ac9-940c-f40c2e5fbcb4 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:25.776852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9d23c-7bf3-4979-8691-a0825f30953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:25.778095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d23c-7bf3-4979-8691-a0825f30953e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:25.778599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d23c-7bf3-4979-8691-a0825f30953e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:25.779063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d23c-7bf3-4979-8691-a0825f30953e None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:25.782311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9d23c-7bf3-4979-8691-a0825f30953e None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:25.784107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9d23c-7bf3-4979-8691-a0825f30953e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:25.786069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 87/155] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:25 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:25.791792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c236-bf51-499f-86a4-1b84733cb60a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:25.913378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c236-bf51-499f-86a4-1b84733cb60a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:25.957973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f454b-f061-49e4-9fc4-c2545e376a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:25.959015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f454b-f061-49e4-9fc4-c2545e376a82 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:25.959644 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f454b-f061-49e4-9fc4-c2545e376a82 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:25.960135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f454b-f061-49e4-9fc4-c2545e376a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:25.961295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f454b-f061-49e4-9fc4-c2545e376a82 None admin] RBAC: Adding query filter params (role.id=1ead91d8230c468cabd0637c833c42ac, scope.project.id=1da154bbce234bbe9e9dfabe1b861662, user.id=a8842ef81bce467bbeb3e3cf1f632151) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:25.961803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f454b-f061-49e4-9fc4-c2545e376a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:25.963520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f454b-f061-49e4-9fc4-c2545e376a82 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:25.973554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 69/156] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:25 2022] GET /identity/v3/role_assignments?user.id=a8842ef81bce467bbeb3e3cf1f632151&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=1ead91d8230c468cabd0637c833c42ac => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:26.701099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a5291-f827-4c86-96a5-a66902c0b3bd None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:26.702063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a5291-f827-4c86-96a5-a66902c0b3bd None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:26.702549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a5291-f827-4c86-96a5-a66902c0b3bd None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:26.704209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 88/157] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:26.713447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3ed94-f6ec-41ff-be4a-d8584a6cda7a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:26.713894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3ed94-f6ec-41ff-be4a-d8584a6cda7a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:26.714091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3ed94-f6ec-41ff-be4a-d8584a6cda7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:26.733799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-56e3ed94-f6ec-41ff-be4a-d8584a6cda7a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:26.735161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-56e3ed94-f6ec-41ff-be4a-d8584a6cda7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:26.807542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 70/158] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:26.830952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a696a1-ff36-47a4-b9a3-73591345977f None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:26.831234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a696a1-ff36-47a4-b9a3-73591345977f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:26.831522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a696a1-ff36-47a4-b9a3-73591345977f None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:26.832961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 89/159] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:26.838466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed5f55-9e5d-4b90-a011-8ca8e18df17a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:26.838767 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed5f55-9e5d-4b90-a011-8ca8e18df17a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:26.839050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed5f55-9e5d-4b90-a011-8ca8e18df17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:26.854293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a696a1-ff36-47a4-b9a3-73591345977f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:26.876994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-28ed5f55-9e5d-4b90-a011-8ca8e18df17a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:26.878204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-28ed5f55-9e5d-4b90-a011-8ca8e18df17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:27.003782 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 71/160] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:27.038207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a696a1-ff36-47a4-b9a3-73591345977f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:27.038610 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed5f55-9e5d-4b90-a011-8ca8e18df17a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:27.118334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dddfac-64c7-4d85-8647-5400ce2e0f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:27.119071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dddfac-64c7-4d85-8647-5400ce2e0f85 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:27.119352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dddfac-64c7-4d85-8647-5400ce2e0f85 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:27.119622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dddfac-64c7-4d85-8647-5400ce2e0f85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:27.153111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dddfac-64c7-4d85-8647-5400ce2e0f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-87dddfac-64c7-4d85-8647-5400ce2e0f85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:27.162036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:27.162958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:27.164163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 90/161] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:52:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:27.182269 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dddfac-64c7-4d85-8647-5400ce2e0f85 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:27.223047 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed5f55-9e5d-4b90-a011-8ca8e18df17a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:27.297881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6ad9-578d-49db-afba-59fa40ed7bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:27.299073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6ad9-578d-49db-afba-59fa40ed7bd9 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:27.299631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6ad9-578d-49db-afba-59fa40ed7bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:27.300102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6ad9-578d-49db-afba-59fa40ed7bd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:27.324093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d6ad9-578d-49db-afba-59fa40ed7bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-f47d6ad9-578d-49db-afba-59fa40ed7bd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:27.332905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:27.333966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:27.334864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:27.341351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 72/162] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:52:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:27.347079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6ad9-578d-49db-afba-59fa40ed7bd9 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:27.402351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dddfac-64c7-4d85-8647-5400ce2e0f85 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:27.467161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdd570-73a8-428c-ad19-1d50a6ab53bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:27.468725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdd570-73a8-428c-ad19-1d50a6ab53bf None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:27.470013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdd570-73a8-428c-ad19-1d50a6ab53bf None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:27.470725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdd570-73a8-428c-ad19-1d50a6ab53bf None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:27.472037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdd570-73a8-428c-ad19-1d50a6ab53bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:27.472608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdd570-73a8-428c-ad19-1d50a6ab53bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:27.474417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdd570-73a8-428c-ad19-1d50a6ab53bf None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:27.486381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 91/163] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:52:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:27.491123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db986d0-2e1f-4652-a18b-9bb4e2c53c64 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:27.491660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db986d0-2e1f-4652-a18b-9bb4e2c53c64 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:27.492140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db986d0-2e1f-4652-a18b-9bb4e2c53c64 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:27.495769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 92/164] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:27.498290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db986d0-2e1f-4652-a18b-9bb4e2c53c64 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:27.534332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6ad9-578d-49db-afba-59fa40ed7bd9 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:27.567005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af65971-897d-4275-8cfe-ec0e74ae877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:27.567688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65971-897d-4275-8cfe-ec0e74ae877b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:27.567979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65971-897d-4275-8cfe-ec0e74ae877b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:27.568294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65971-897d-4275-8cfe-ec0e74ae877b None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:27.569060 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af65971-897d-4275-8cfe-ec0e74ae877b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:27.569374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af65971-897d-4275-8cfe-ec0e74ae877b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:27.570773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af65971-897d-4275-8cfe-ec0e74ae877b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:27.585793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 73/165] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:27.587177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deb502-a936-4ba0-abad-3072fd5a9f3c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:27.587479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deb502-a936-4ba0-abad-3072fd5a9f3c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:27.587761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deb502-a936-4ba0-abad-3072fd5a9f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:27.617237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-47deb502-a936-4ba0-abad-3072fd5a9f3c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:27.618470 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-47deb502-a936-4ba0-abad-3072fd5a9f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:27.656448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db986d0-2e1f-4652-a18b-9bb4e2c53c64 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:27.728335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 74/166] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:27.729325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deb502-a936-4ba0-abad-3072fd5a9f3c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:27.732891 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645d2e7-f8aa-4019-bdcb-dea5b37221be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:27.733783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645d2e7-f8aa-4019-bdcb-dea5b37221be None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:27.734072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645d2e7-f8aa-4019-bdcb-dea5b37221be None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:27.734355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645d2e7-f8aa-4019-bdcb-dea5b37221be None admin] PATH_INFO: `/v3/users/a8842ef81bce467bbeb3e3cf1f632151` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:27.736894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645d2e7-f8aa-4019-bdcb-dea5b37221be None admin] RBAC: Authorizing `identity:get_user(user_id=a8842ef81bce467bbeb3e3cf1f632151)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:27.738364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645d2e7-f8aa-4019-bdcb-dea5b37221be None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:27.739998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 93/167] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:27 2022] GET /identity/v3/users/a8842ef81bce467bbeb3e3cf1f632151 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:27.747343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645d2e7-f8aa-4019-bdcb-dea5b37221be None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:27.832666 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deb502-a936-4ba0-abad-3072fd5a9f3c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:27.869655 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bf21d-e1d0-4b90-8f38-b4bb1d9d5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:27.870534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bf21d-e1d0-4b90-8f38-b4bb1d9d5bec None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:27.870818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bf21d-e1d0-4b90-8f38-b4bb1d9d5bec None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:27.871120 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bf21d-e1d0-4b90-8f38-b4bb1d9d5bec None admin] PATH_INFO: `/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:27.872826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bf21d-e1d0-4b90-8f38-b4bb1d9d5bec None admin] RBAC: Authorizing `identity:get_user(user_id=f0ae019bc4584bc39f9f7fb0d0af90e6)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:27.874292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bf21d-e1d0-4b90-8f38-b4bb1d9d5bec None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:27.879771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 75/168] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:27 2022] GET /identity/v3/users/f0ae019bc4584bc39f9f7fb0d0af90e6 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:27.880603 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bf21d-e1d0-4b90-8f38-b4bb1d9d5bec None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:27.953451 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645d2e7-f8aa-4019-bdcb-dea5b37221be None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:28.068541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bf21d-e1d0-4b90-8f38-b4bb1d9d5bec None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:28.068956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6cd4f-3ef6-44f8-84cd-eb4d8710251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:28.076204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6cd4f-3ef6-44f8-84cd-eb4d8710251c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:28.076204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6cd4f-3ef6-44f8-84cd-eb4d8710251c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:28.076204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6cd4f-3ef6-44f8-84cd-eb4d8710251c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:28.128881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08519b09-c1d1-4b9a-ba06-402530b63940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:28.130095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519b09-c1d1-4b9a-ba06-402530b63940 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:28.130574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519b09-c1d1-4b9a-ba06-402530b63940 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:28.131053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08519b09-c1d1-4b9a-ba06-402530b63940 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:28.145607 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08519b09-c1d1-4b9a-ba06-402530b63940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:28.160202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6cd4f-3ef6-44f8-84cd-eb4d8710251c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:28.160202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6cd4f-3ef6-44f8-84cd-eb4d8710251c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-08519b09-c1d1-4b9a-ba06-402530b63940 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:28.162227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:28.163032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:28.163797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:28.166294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 76/169] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:28.167337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08519b09-c1d1-4b9a-ba06-402530b63940 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:28.317617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08519b09-c1d1-4b9a-ba06-402530b63940 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:28.348285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 94/170] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 11:52:28.349608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6cd4f-3ef6-44f8-84cd-eb4d8710251c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:28.398370 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353b7c6-813d-4b6d-bd87-233d19307573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:28.399040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b7c6-813d-4b6d-bd87-233d19307573 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:28.399329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b7c6-813d-4b6d-bd87-233d19307573 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:28.399611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b7c6-813d-4b6d-bd87-233d19307573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:28.470193 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6cd4f-3ef6-44f8-84cd-eb4d8710251c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:28.515067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481bc7b-695e-47b5-ad41-3a2c5bf6bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:28.517731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481bc7b-695e-47b5-ad41-3a2c5bf6bfbc None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:28.518223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481bc7b-695e-47b5-ad41-3a2c5bf6bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:28.518777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481bc7b-695e-47b5-ad41-3a2c5bf6bfbc None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:28.520010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481bc7b-695e-47b5-ad41-3a2c5bf6bfbc None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:28.521733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481bc7b-695e-47b5-ad41-3a2c5bf6bfbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:28.523350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481bc7b-695e-47b5-ad41-3a2c5bf6bfbc None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:28.542698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 95/171] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:28.546443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68454cb4-df42-4df4-8426-0c1d03736498 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:28.549536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68454cb4-df42-4df4-8426-0c1d03736498 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:28.549835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68454cb4-df42-4df4-8426-0c1d03736498 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:28.551170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 96/172] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:28.552367 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353b7c6-813d-4b6d-bd87-233d19307573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:28.553437 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68454cb4-df42-4df4-8426-0c1d03736498 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:28.554965 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353b7c6-813d-4b6d-bd87-233d19307573 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:28.682155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 77/173] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:28.683427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353b7c6-813d-4b6d-bd87-233d19307573 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:28.781410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68454cb4-df42-4df4-8426-0c1d03736498 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:28.797597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353b7c6-813d-4b6d-bd87-233d19307573 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:28.839304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efee47f-ba97-44ea-8506-cc02d90596f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:28.840196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee47f-ba97-44ea-8506-cc02d90596f7 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:28.840485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee47f-ba97-44ea-8506-cc02d90596f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:28.840761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee47f-ba97-44ea-8506-cc02d90596f7 None admin] PATH_INFO: `/v3/users/a8842ef81bce467bbeb3e3cf1f632151` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:28.841171 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc3508-0827-408e-b59a-182c93834eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:28.842067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efee47f-ba97-44ea-8506-cc02d90596f7 None admin] RBAC: Authorizing `identity:get_user(user_id=a8842ef81bce467bbeb3e3cf1f632151)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:28.842502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc3508-0827-408e-b59a-182c93834eca None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:28.842969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc3508-0827-408e-b59a-182c93834eca None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:28.843428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc3508-0827-408e-b59a-182c93834eca None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:28.843525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efee47f-ba97-44ea-8506-cc02d90596f7 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:28.845550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc3508-0827-408e-b59a-182c93834eca None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:28.846043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 78/174] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:28 2022] GET /identity/v3/users/a8842ef81bce467bbeb3e3cf1f632151 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:28.847360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d3ad-6e9a-4b7a-be95-3d963bc4b3e5 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:28.847623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc3508-0827-408e-b59a-182c93834eca None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:28.847720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d3ad-6e9a-4b7a-be95-3d963bc4b3e5 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:28.847906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d3ad-6e9a-4b7a-be95-3d963bc4b3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:28.850338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 97/175] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:28 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:28.851501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc3508-0827-408e-b59a-182c93834eca None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:28.873561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-9314d3ad-6e9a-4b7a-be95-3d963bc4b3e5 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:28.875719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9314d3ad-6e9a-4b7a-be95-3d963bc4b3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:28.956968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc3508-0827-408e-b59a-182c93834eca None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:28.963229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 79/176] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:28.964782 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed652a-cce7-4ecc-870d-dfcadd44f29c None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:28.964907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed652a-cce7-4ecc-870d-dfcadd44f29c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:28.965157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed652a-cce7-4ecc-870d-dfcadd44f29c None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:28.966678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 80/177] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:28.967618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed652a-cce7-4ecc-870d-dfcadd44f29c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:28.994595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc7b16-0d73-4f44-92df-585b5691eb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:28.995682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc7b16-0d73-4f44-92df-585b5691eb19 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:28.996112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc7b16-0d73-4f44-92df-585b5691eb19 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:28.996591 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc7b16-0d73-4f44-92df-585b5691eb19 None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:28.997916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc7b16-0d73-4f44-92df-585b5691eb19 None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:28.999500 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc7b16-0d73-4f44-92df-585b5691eb19 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:29.002135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 98/178] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:28 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:29.003172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc7b16-0d73-4f44-92df-585b5691eb19 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:29.075316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed652a-cce7-4ecc-870d-dfcadd44f29c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:29.106440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc7b16-0d73-4f44-92df-585b5691eb19 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:29.111933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e77253-ebb2-45bf-bc1b-d3055f253a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:29.112619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e77253-ebb2-45bf-bc1b-d3055f253a23 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.112907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e77253-ebb2-45bf-bc1b-d3055f253a23 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.113186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e77253-ebb2-45bf-bc1b-d3055f253a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.139585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d10b77-4a7a-4fa3-a461-11a029595a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:29.140265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d10b77-4a7a-4fa3-a461-11a029595a13 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.140551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d10b77-4a7a-4fa3-a461-11a029595a13 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.141439 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d10b77-4a7a-4fa3-a461-11a029595a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.142296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d10b77-4a7a-4fa3-a461-11a029595a13 None admin] RBAC: Adding query filter params (role.id=297b3b3e5982438e9af6c05761718fcc, scope.project.id=1da154bbce234bbe9e9dfabe1b861662, user.id=a8842ef81bce467bbeb3e3cf1f632151) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:29.142609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d10b77-4a7a-4fa3-a461-11a029595a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:29.144053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d10b77-4a7a-4fa3-a461-11a029595a13 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:29.156254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 99/179] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:29 2022] GET /identity/v3/role_assignments?user.id=a8842ef81bce467bbeb3e3cf1f632151&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=297b3b3e5982438e9af6c05761718fcc => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:29.156254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90853d3d-e7f6-4217-bd09-576cea88c885 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.156254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90853d3d-e7f6-4217-bd09-576cea88c885 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.156254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90853d3d-e7f6-4217-bd09-576cea88c885 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.156254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 100/180] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:29.158744 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9feb9-89e4-4b41-9cce-62d26232ccaf None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.158814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9feb9-89e4-4b41-9cce-62d26232ccaf None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.159032 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9feb9-89e4-4b41-9cce-62d26232ccaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.189592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-22b9feb9-89e4-4b41-9cce-62d26232ccaf None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:29.191102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-22b9feb9-89e4-4b41-9cce-62d26232ccaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:29.191387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e77253-ebb2-45bf-bc1b-d3055f253a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:29.193234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e77253-ebb2-45bf-bc1b-d3055f253a23 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:29.273384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 101/181] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:29.274572 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9feb9-89e4-4b41-9cce-62d26232ccaf None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:29.315344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 81/182] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:29.316246 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e77253-ebb2-45bf-bc1b-d3055f253a23 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:29.384693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9feb9-89e4-4b41-9cce-62d26232ccaf None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:29.427876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f28646-d071-4ecb-8b10-d45499fa8349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:29.428730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f28646-d071-4ecb-8b10-d45499fa8349 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.429017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f28646-d071-4ecb-8b10-d45499fa8349 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.429209 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e77253-ebb2-45bf-bc1b-d3055f253a23 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:29.429324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f28646-d071-4ecb-8b10-d45499fa8349 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.440617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f28646-d071-4ecb-8b10-d45499fa8349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-f9f28646-d071-4ecb-8b10-d45499fa8349 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:29.448381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:29.449222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:29.449993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 102/183] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:52:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:29.450793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ee4c4-722b-4134-8044-f82e10da4a73 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.451098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ee4c4-722b-4134-8044-f82e10da4a73 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.451361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ee4c4-722b-4134-8044-f82e10da4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.465347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9172d22-b564-4ce3-a173-509fa93f296a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:29.466001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9172d22-b564-4ce3-a173-509fa93f296a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.466283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9172d22-b564-4ce3-a173-509fa93f296a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.466558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9172d22-b564-4ce3-a173-509fa93f296a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.467389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9172d22-b564-4ce3-a173-509fa93f296a None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=1da154bbce234bbe9e9dfabe1b861662, user.id=f0ae019bc4584bc39f9f7fb0d0af90e6) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:29.467703 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9172d22-b564-4ce3-a173-509fa93f296a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:29.468441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-8e7ee4c4-722b-4134-8044-f82e10da4a73 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:29.469835 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9172d22-b564-4ce3-a173-509fa93f296a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:29.470270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-8e7ee4c4-722b-4134-8044-f82e10da4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:29.475448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 82/184] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:29 2022] GET /identity/v3/role_assignments?user.id=f0ae019bc4584bc39f9f7fb0d0af90e6&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=3db33dfd3d6544fd81933007633fc56a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:29.476706 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663372ce-e872-4204-89f5-06cb6abfaab3 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.476989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663372ce-e872-4204-89f5-06cb6abfaab3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.477266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663372ce-e872-4204-89f5-06cb6abfaab3 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.478490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 83/185] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:29.479189 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663372ce-e872-4204-89f5-06cb6abfaab3 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:29.550337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 103/186] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:29.551215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ee4c4-722b-4134-8044-f82e10da4a73 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:29.608162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663372ce-e872-4204-89f5-06cb6abfaab3 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:29.645036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0f608-32cf-4fc7-97e6-cebae0a4a7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:29.645868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0f608-32cf-4fc7-97e6-cebae0a4a7bf None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.646145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0f608-32cf-4fc7-97e6-cebae0a4a7bf None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.646419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0f608-32cf-4fc7-97e6-cebae0a4a7bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.658381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0f608-32cf-4fc7-97e6-cebae0a4a7bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:29.658836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ee4c4-722b-4134-8044-f82e10da4a73 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-03d0f608-32cf-4fc7-97e6-cebae0a4a7bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:29.666481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:29.667349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:29.668099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 84/187] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:52:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:29.668753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0f608-32cf-4fc7-97e6-cebae0a4a7bf None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:29.700258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caed38a-a11a-4f80-9fb7-877209f1ab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:29.701133 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caed38a-a11a-4f80-9fb7-877209f1ab2c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.701516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caed38a-a11a-4f80-9fb7-877209f1ab2c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.701765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caed38a-a11a-4f80-9fb7-877209f1ab2c None admin] PATH_INFO: `/v3/projects/cc8114d145884705a409a292ab16323e` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.702869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caed38a-a11a-4f80-9fb7-877209f1ab2c None admin] RBAC: Authorizing `identity:get_project(project_id=cc8114d145884705a409a292ab16323e)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:29.704647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caed38a-a11a-4f80-9fb7-877209f1ab2c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:29.706643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 104/188] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:29 2022] GET /identity/v3/projects/cc8114d145884705a409a292ab16323e => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:29.707823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527a1b3-c318-4c2e-8583-c49052777009 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.708110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527a1b3-c318-4c2e-8583-c49052777009 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.708415 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527a1b3-c318-4c2e-8583-c49052777009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.726400 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c527a1b3-c318-4c2e-8583-c49052777009 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:29.727581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c527a1b3-c318-4c2e-8583-c49052777009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:29.778560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0f608-32cf-4fc7-97e6-cebae0a4a7bf None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:29.792242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 105/189] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:29.793025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527a1b3-c318-4c2e-8583-c49052777009 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:29.811232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390f142-be66-4b95-86dd-3379b29bbf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:29.811907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f142-be66-4b95-86dd-3379b29bbf89 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.812212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f142-be66-4b95-86dd-3379b29bbf89 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.812497 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f142-be66-4b95-86dd-3379b29bbf89 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.813804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390f142-be66-4b95-86dd-3379b29bbf89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:29.814116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390f142-be66-4b95-86dd-3379b29bbf89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:29.815539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390f142-be66-4b95-86dd-3379b29bbf89 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:29.823550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 85/190] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:29.824373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390f142-be66-4b95-86dd-3379b29bbf89 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:29.886774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527a1b3-c318-4c2e-8583-c49052777009 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:29.917582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390f142-be66-4b95-86dd-3379b29bbf89 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:29.918431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f307e-6c71-4271-abf6-f1c84024cafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:29.919218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f307e-6c71-4271-abf6-f1c84024cafe None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.919501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f307e-6c71-4271-abf6-f1c84024cafe None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.919777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f307e-6c71-4271-abf6-f1c84024cafe None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.920954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f307e-6c71-4271-abf6-f1c84024cafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:29.923069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f307e-6c71-4271-abf6-f1c84024cafe None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:29.925077 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 106/191] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:29.925874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f307e-6c71-4271-abf6-f1c84024cafe None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:29.951150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4d320-ed9d-4064-94fe-98266c2423dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:29.951811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d320-ed9d-4064-94fe-98266c2423dc None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:29.952095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d320-ed9d-4064-94fe-98266c2423dc None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:29.952396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d320-ed9d-4064-94fe-98266c2423dc None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:29.953144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4d320-ed9d-4064-94fe-98266c2423dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:29.953513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4d320-ed9d-4064-94fe-98266c2423dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:29.954886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4d320-ed9d-4064-94fe-98266c2423dc None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:29.962471 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 86/192] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:52:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:29.963251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4d320-ed9d-4064-94fe-98266c2423dc None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:30.021499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f307e-6c71-4271-abf6-f1c84024cafe None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:30.053576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1364e-58fe-4470-985e-1aed02be48e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:30.054164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1364e-58fe-4470-985e-1aed02be48e9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:30.054448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1364e-58fe-4470-985e-1aed02be48e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:30.054727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1364e-58fe-4470-985e-1aed02be48e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:30.055373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4d320-ed9d-4064-94fe-98266c2423dc None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:30.055552 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1364e-58fe-4470-985e-1aed02be48e9 None admin] RBAC: Adding query filter params (role.id=1ead91d8230c468cabd0637c833c42ac, scope.project.id=cc8114d145884705a409a292ab16323e, user.id=a8842ef81bce467bbeb3e3cf1f632151) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:30.055864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1364e-58fe-4470-985e-1aed02be48e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:30.057335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1364e-58fe-4470-985e-1aed02be48e9 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:30.063937 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 107/193] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:29 2022] GET /identity/v3/role_assignments?user.id=a8842ef81bce467bbeb3e3cf1f632151&scope.project.id=cc8114d145884705a409a292ab16323e&role.id=1ead91d8230c468cabd0637c833c42ac => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:30.064760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1364e-58fe-4470-985e-1aed02be48e9 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:30.094840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522667a7-50af-476e-9bd6-997626de9101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:30.095662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522667a7-50af-476e-9bd6-997626de9101 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:30.095948 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522667a7-50af-476e-9bd6-997626de9101 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:30.096261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522667a7-50af-476e-9bd6-997626de9101 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:30.108320 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522667a7-50af-476e-9bd6-997626de9101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-522667a7-50af-476e-9bd6-997626de9101 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:30.116825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:30.117858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:30.118621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 87/194] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:30.119249 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522667a7-50af-476e-9bd6-997626de9101 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:30.177103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1364e-58fe-4470-985e-1aed02be48e9 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:30.211645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6671a-84d6-4714-bd38-a85128e608a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:30.212546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6671a-84d6-4714-bd38-a85128e608a6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:30.212831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6671a-84d6-4714-bd38-a85128e608a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:30.213106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6671a-84d6-4714-bd38-a85128e608a6 None admin] PATH_INFO: `/v3/users/02e8fbca83d74332a610a95cfda2cc0f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:30.223506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522667a7-50af-476e-9bd6-997626de9101 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:30.228522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6671a-84d6-4714-bd38-a85128e608a6 None admin] RBAC: Authorizing `identity:get_user(user_id=02e8fbca83d74332a610a95cfda2cc0f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:30.230103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6671a-84d6-4714-bd38-a85128e608a6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:30.232095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 108/195] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:30 2022] GET /identity/v3/users/02e8fbca83d74332a610a95cfda2cc0f => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:30.232895 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6671a-84d6-4714-bd38-a85128e608a6 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:30.267617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb703dc8-67ef-4beb-9abc-c8b2419d2ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:30.268029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb703dc8-67ef-4beb-9abc-c8b2419d2ff6 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:30.268339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb703dc8-67ef-4beb-9abc-c8b2419d2ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:30.268622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb703dc8-67ef-4beb-9abc-c8b2419d2ff6 None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:30.269340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb703dc8-67ef-4beb-9abc-c8b2419d2ff6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:30.270792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb703dc8-67ef-4beb-9abc-c8b2419d2ff6 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:30.292444 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 88/196] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:52:30 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:30.293389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb703dc8-67ef-4beb-9abc-c8b2419d2ff6 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:30.348697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6671a-84d6-4714-bd38-a85128e608a6 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:30.393674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73182812-38e5-4909-9c32-90e71bea943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:30.394555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73182812-38e5-4909-9c32-90e71bea943e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:30.394840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73182812-38e5-4909-9c32-90e71bea943e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:30.395115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73182812-38e5-4909-9c32-90e71bea943e None admin] PATH_INFO: `/v3/users/02e8fbca83d74332a610a95cfda2cc0f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:30.396530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73182812-38e5-4909-9c32-90e71bea943e None admin] RBAC: Authorizing `identity:get_user(user_id=02e8fbca83d74332a610a95cfda2cc0f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:30.398027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73182812-38e5-4909-9c32-90e71bea943e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:30.404367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 109/197] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:30 2022] GET /identity/v3/users/02e8fbca83d74332a610a95cfda2cc0f => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:30.404367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73182812-38e5-4909-9c32-90e71bea943e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:30.413236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb703dc8-67ef-4beb-9abc-c8b2419d2ff6 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:30.449595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b1050-26f2-4bca-93fd-67969cecc236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:30.450273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b1050-26f2-4bca-93fd-67969cecc236 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:30.450557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b1050-26f2-4bca-93fd-67969cecc236 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:30.450831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b1050-26f2-4bca-93fd-67969cecc236 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:30.451591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b1050-26f2-4bca-93fd-67969cecc236 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:30.451902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b1050-26f2-4bca-93fd-67969cecc236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:30.454079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b1050-26f2-4bca-93fd-67969cecc236 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:30.462978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 89/198] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:30.462978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b1050-26f2-4bca-93fd-67969cecc236 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:30.521025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73182812-38e5-4909-9c32-90e71bea943e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:30.560230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761ea5a-c42a-4c35-9c54-c6fded108784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:30.560230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ea5a-c42a-4c35-9c54-c6fded108784 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:30.560230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ea5a-c42a-4c35-9c54-c6fded108784 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:30.560230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ea5a-c42a-4c35-9c54-c6fded108784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:30.566591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b1050-26f2-4bca-93fd-67969cecc236 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:30.605302 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981541ee-3a76-45c0-a25c-030fda30c59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:30.605503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981541ee-3a76-45c0-a25c-030fda30c59e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:30.605635 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981541ee-3a76-45c0-a25c-030fda30c59e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:30.605912 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981541ee-3a76-45c0-a25c-030fda30c59e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:30.649666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ea5a-c42a-4c35-9c54-c6fded108784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:30.651728 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ea5a-c42a-4c35-9c54-c6fded108784 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:30.680390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981541ee-3a76-45c0-a25c-030fda30c59e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:30.680895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981541ee-3a76-45c0-a25c-030fda30c59e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:30.777134 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 110/199] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:30.778286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761ea5a-c42a-4c35-9c54-c6fded108784 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:30.784242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 90/200] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:30.790280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981541ee-3a76-45c0-a25c-030fda30c59e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:30.893397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981541ee-3a76-45c0-a25c-030fda30c59e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:30.902373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761ea5a-c42a-4c35-9c54-c6fded108784 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:30.928500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d657a-8e60-4947-894e-c3ef44f8b8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:30.929586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d657a-8e60-4947-894e-c3ef44f8b8e7 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:30.929968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d657a-8e60-4947-894e-c3ef44f8b8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:30.930377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d657a-8e60-4947-894e-c3ef44f8b8e7 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:30.931671 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d657a-8e60-4947-894e-c3ef44f8b8e7 None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:30.933451 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d657a-8e60-4947-894e-c3ef44f8b8e7 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:30.940477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 91/201] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:30 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:30.940477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d657a-8e60-4947-894e-c3ef44f8b8e7 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:30.945523 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4c57b-e932-4425-8de5-861de4bd000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:30.946670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4c57b-e932-4425-8de5-861de4bd000b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:30.947147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4c57b-e932-4425-8de5-861de4bd000b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:30.947631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4c57b-e932-4425-8de5-861de4bd000b None admin] PATH_INFO: `/v3/users/0b3801c5fdcb4483b752e852febd230e` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:30.949098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4c57b-e932-4425-8de5-861de4bd000b None admin] RBAC: Authorizing `identity:get_user(user_id=0b3801c5fdcb4483b752e852febd230e)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:30.950670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4c57b-e932-4425-8de5-861de4bd000b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:30.952732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 111/202] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:30 2022] GET /identity/v3/users/0b3801c5fdcb4483b752e852febd230e => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:30.953775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4c57b-e932-4425-8de5-861de4bd000b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:31.044135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d657a-8e60-4947-894e-c3ef44f8b8e7 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:31.059585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4c57b-e932-4425-8de5-861de4bd000b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:31.085452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e38ac-d49f-4994-9dc5-feb49f1e686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:31.086368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e38ac-d49f-4994-9dc5-feb49f1e686a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:31.086650 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e38ac-d49f-4994-9dc5-feb49f1e686a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:31.086920 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e38ac-d49f-4994-9dc5-feb49f1e686a None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:31.088120 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e38ac-d49f-4994-9dc5-feb49f1e686a None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:31.089591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e38ac-d49f-4994-9dc5-feb49f1e686a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:31.091286 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 92/203] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:30 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:31.092042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e38ac-d49f-4994-9dc5-feb49f1e686a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:31.094497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9fc58-6566-41a5-8aa4-1cbb06fa57b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:31.095259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9fc58-6566-41a5-8aa4-1cbb06fa57b3 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:31.095544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9fc58-6566-41a5-8aa4-1cbb06fa57b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:31.095821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9fc58-6566-41a5-8aa4-1cbb06fa57b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:31.097011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9fc58-6566-41a5-8aa4-1cbb06fa57b3 None admin] RBAC: Adding query filter params (role.id=297b3b3e5982438e9af6c05761718fcc, scope.project.id=83915a029ef141e7a371da8296ea927d, user.id=02e8fbca83d74332a610a95cfda2cc0f) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:31.097336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9fc58-6566-41a5-8aa4-1cbb06fa57b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:31.098786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9fc58-6566-41a5-8aa4-1cbb06fa57b3 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:31.104890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 112/204] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:30 2022] GET /identity/v3/role_assignments?user.id=02e8fbca83d74332a610a95cfda2cc0f&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=297b3b3e5982438e9af6c05761718fcc => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:31.105810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9fc58-6566-41a5-8aa4-1cbb06fa57b3 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:31.208005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e38ac-d49f-4994-9dc5-feb49f1e686a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:31.267196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba353211-c3cc-4e0e-b7a7-4708165a4b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:31.267889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353211-c3cc-4e0e-b7a7-4708165a4b18 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:31.268264 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353211-c3cc-4e0e-b7a7-4708165a4b18 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:31.268543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba353211-c3cc-4e0e-b7a7-4708165a4b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:31.299018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9fc58-6566-41a5-8aa4-1cbb06fa57b3 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:31.343721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7be935-84aa-4642-bd41-225e7286fc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:31.344623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7be935-84aa-4642-bd41-225e7286fc9d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:31.345023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7be935-84aa-4642-bd41-225e7286fc9d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:31.345300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7be935-84aa-4642-bd41-225e7286fc9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:31.346142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7be935-84aa-4642-bd41-225e7286fc9d None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=83915a029ef141e7a371da8296ea927d, user.id=02e8fbca83d74332a610a95cfda2cc0f) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:31.346451 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7be935-84aa-4642-bd41-225e7286fc9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:31.347919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7be935-84aa-4642-bd41-225e7286fc9d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:31.354335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 113/205] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:31 2022] GET /identity/v3/role_assignments?user.id=02e8fbca83d74332a610a95cfda2cc0f&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=3db33dfd3d6544fd81933007633fc56a => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:31.381784 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba353211-c3cc-4e0e-b7a7-4708165a4b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:31.383291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba353211-c3cc-4e0e-b7a7-4708165a4b18 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:31.489489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 93/206] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:31.497416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7be935-84aa-4642-bd41-225e7286fc9d None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:31.658452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7be935-84aa-4642-bd41-225e7286fc9d None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:31.705498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3553fca-e961-4b6c-b5d6-1362c109fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:31.706737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553fca-e961-4b6c-b5d6-1362c109fe36 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:31.707216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553fca-e961-4b6c-b5d6-1362c109fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:31.707685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3553fca-e961-4b6c-b5d6-1362c109fe36 None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:31.709092 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3553fca-e961-4b6c-b5d6-1362c109fe36 None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:31.710774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3553fca-e961-4b6c-b5d6-1362c109fe36 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:31.712684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 114/207] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:31 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:31.718711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba353211-c3cc-4e0e-b7a7-4708165a4b18 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:31.840502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba353211-c3cc-4e0e-b7a7-4708165a4b18 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:31.879759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1e851-21bf-4a5e-b165-6ba3e9ae2e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:31.880447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1e851-21bf-4a5e-b165-6ba3e9ae2e81 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:31.880729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1e851-21bf-4a5e-b165-6ba3e9ae2e81 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:31.881006 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1e851-21bf-4a5e-b165-6ba3e9ae2e81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:31.881843 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1e851-21bf-4a5e-b165-6ba3e9ae2e81 None admin] RBAC: Adding query filter params (role.id=771bd64f51c4466a934ee622fea6214f, scope.project.id=1da154bbce234bbe9e9dfabe1b861662, user.id=0b3801c5fdcb4483b752e852febd230e) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:31.882154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1e851-21bf-4a5e-b165-6ba3e9ae2e81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:31.883591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1e851-21bf-4a5e-b165-6ba3e9ae2e81 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:31.890037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 94/208] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:31 2022] GET /identity/v3/role_assignments?user.id=0b3801c5fdcb4483b752e852febd230e&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=771bd64f51c4466a934ee622fea6214f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:33.003496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab18b11-8a6c-430a-b5d5-04737a3e5a3b None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.004499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab18b11-8a6c-430a-b5d5-04737a3e5a3b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.005009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab18b11-8a6c-430a-b5d5-04737a3e5a3b None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.006658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 115/209] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:33.012003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332221-afee-4df8-ab2e-936d6162b7c9 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.012434 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332221-afee-4df8-ab2e-936d6162b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.012619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332221-afee-4df8-ab2e-936d6162b7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.029911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-68332221-afee-4df8-ab2e-936d6162b7c9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:33.031097 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-68332221-afee-4df8-ab2e-936d6162b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:33.050199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e498d47-a290-46ae-8596-4d4f0087ef08 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.050794 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e498d47-a290-46ae-8596-4d4f0087ef08 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.051269 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e498d47-a290-46ae-8596-4d4f0087ef08 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.053261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 116/210] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:33.058804 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6d718-8914-473f-b819-0d47d19d9b72 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.059892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6d718-8914-473f-b819-0d47d19d9b72 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.060682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6d718-8914-473f-b819-0d47d19d9b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.082014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-93c6d718-8914-473f-b819-0d47d19d9b72 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:33.083925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-93c6d718-8914-473f-b819-0d47d19d9b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:33.099231 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 95/211] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:33.122492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332221-afee-4df8-ab2e-936d6162b7c9 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:33.172204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 117/212] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:33.190503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6d718-8914-473f-b819-0d47d19d9b72 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:33.238578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332221-afee-4df8-ab2e-936d6162b7c9 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:33.273912 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c8284-2309-4760-8223-10a4633b77cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:33.274614 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8284-2309-4760-8223-10a4633b77cf None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.274892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8284-2309-4760-8223-10a4633b77cf None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.275164 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c8284-2309-4760-8223-10a4633b77cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.286118 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c8284-2309-4760-8223-10a4633b77cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-513c8284-2309-4760-8223-10a4633b77cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:33.294013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:33.295797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:33.298413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 96/213] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:33.302213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c8284-2309-4760-8223-10a4633b77cf None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:33.313412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6d718-8914-473f-b819-0d47d19d9b72 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:33.352962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71fc58-dd63-4820-8054-35c063c4b4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:33.354141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71fc58-dd63-4820-8054-35c063c4b4ec None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.354650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71fc58-dd63-4820-8054-35c063c4b4ec None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.355121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71fc58-dd63-4820-8054-35c063c4b4ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.356692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71fc58-dd63-4820-8054-35c063c4b4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:33.358470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71fc58-dd63-4820-8054-35c063c4b4ec None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:33.361040 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 118/214] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:33.366901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71fc58-dd63-4820-8054-35c063c4b4ec None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:33.409157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c8284-2309-4760-8223-10a4633b77cf None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:33.445548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726f45d-3c3f-4b96-8931-5888e3b70c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:33.446507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726f45d-3c3f-4b96-8931-5888e3b70c1e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.446507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726f45d-3c3f-4b96-8931-5888e3b70c1e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.446804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726f45d-3c3f-4b96-8931-5888e3b70c1e None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.447562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726f45d-3c3f-4b96-8931-5888e3b70c1e None admin] RBAC: Adding query filter params (name=member) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:33.447871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726f45d-3c3f-4b96-8931-5888e3b70c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:33.449291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726f45d-3c3f-4b96-8931-5888e3b70c1e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:33.459306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 97/215] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:33.464542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726f45d-3c3f-4b96-8931-5888e3b70c1e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:33.471841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71fc58-dd63-4820-8054-35c063c4b4ec None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:33.506672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606aa02-e828-4aec-adae-405d6d81a000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:33.507733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606aa02-e828-4aec-adae-405d6d81a000 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.508307 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606aa02-e828-4aec-adae-405d6d81a000 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.508774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606aa02-e828-4aec-adae-405d6d81a000 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.509669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606aa02-e828-4aec-adae-405d6d81a000 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:33.511331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606aa02-e828-4aec-adae-405d6d81a000 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:33.541313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 119/216] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:52:33 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:52:33.542882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382727f5-b5de-4f47-adcc-7a79f2f79386 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.543168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382727f5-b5de-4f47-adcc-7a79f2f79386 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.543443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382727f5-b5de-4f47-adcc-7a79f2f79386 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.544718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 120/217] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:33.554105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10cb8-364e-433c-907d-b3ce38bd5fb6 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.554486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10cb8-364e-433c-907d-b3ce38bd5fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.554834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10cb8-364e-433c-907d-b3ce38bd5fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.578058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-b7b10cb8-364e-433c-907d-b3ce38bd5fb6 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:33.580739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b7b10cb8-364e-433c-907d-b3ce38bd5fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:33.581520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726f45d-3c3f-4b96-8931-5888e3b70c1e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:33.617233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388662f2-1120-48ef-8bd6-23ea34ef616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:33.618330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388662f2-1120-48ef-8bd6-23ea34ef616d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.618692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388662f2-1120-48ef-8bd6-23ea34ef616d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.619096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388662f2-1120-48ef-8bd6-23ea34ef616d None admin] PATH_INFO: `/v3/users/c7521d8b01864bb7a6c20a8ce347d86e` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.635455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388662f2-1120-48ef-8bd6-23ea34ef616d None admin] RBAC: Authorizing `identity:get_user(user_id=c7521d8b01864bb7a6c20a8ce347d86e)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:33.637165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388662f2-1120-48ef-8bd6-23ea34ef616d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:33.639064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 98/218] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:33 2022] GET /identity/v3/users/c7521d8b01864bb7a6c20a8ce347d86e => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:33.645326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388662f2-1120-48ef-8bd6-23ea34ef616d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:33.676142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 121/219] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:33.699031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10cb8-364e-433c-907d-b3ce38bd5fb6 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:33.784821 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388662f2-1120-48ef-8bd6-23ea34ef616d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:33.828047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10cb8-364e-433c-907d-b3ce38bd5fb6 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:33.837606 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdaa99-f829-437e-833a-0f90f0f603bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:33.838275 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdaa99-f829-437e-833a-0f90f0f603bf None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.838560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdaa99-f829-437e-833a-0f90f0f603bf None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.838836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdaa99-f829-437e-833a-0f90f0f603bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.875930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb7df4-f261-486d-b975-34db8e931831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:33.876768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb7df4-f261-486d-b975-34db8e931831 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:33.877692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb7df4-f261-486d-b975-34db8e931831 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:33.877692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb7df4-f261-486d-b975-34db8e931831 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:33.895682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb7df4-f261-486d-b975-34db8e931831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-f5cb7df4-f261-486d-b975-34db8e931831 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:33.904334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:33.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:33.906005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:33.908104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 122/220] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:52:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:33.913933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb7df4-f261-486d-b975-34db8e931831 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:33.918420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdaa99-f829-437e-833a-0f90f0f603bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:33.919892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdaa99-f829-437e-833a-0f90f0f603bf None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:34.036529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb7df4-f261-486d-b975-34db8e931831 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:34.037033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 99/221] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 11:52:34.038443 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb37f12-5261-40ce-989d-283dd4fd2ea1 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:34.038723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb37f12-5261-40ce-989d-283dd4fd2ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:34.039009 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb37f12-5261-40ce-989d-283dd4fd2ea1 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:34.041163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 100/222] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:34.044567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb37f12-5261-40ce-989d-283dd4fd2ea1 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:34.070573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d80ed-1ea1-4045-8da9-88b3e553bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:34.071317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d80ed-1ea1-4045-8da9-88b3e553bef4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:34.071520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d80ed-1ea1-4045-8da9-88b3e553bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:34.071792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d80ed-1ea1-4045-8da9-88b3e553bef4 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:34.072564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d80ed-1ea1-4045-8da9-88b3e553bef4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:34.072871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d80ed-1ea1-4045-8da9-88b3e553bef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:34.074250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d80ed-1ea1-4045-8da9-88b3e553bef4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:34.082789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 123/223] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:52:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:34.088257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324d23-fca2-41f5-86c9-73fb42c5448b None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:34.088257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324d23-fca2-41f5-86c9-73fb42c5448b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:34.088257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324d23-fca2-41f5-86c9-73fb42c5448b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:34.103834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-42324d23-fca2-41f5-86c9-73fb42c5448b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:34.105033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-42324d23-fca2-41f5-86c9-73fb42c5448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:34.163388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb37f12-5261-40ce-989d-283dd4fd2ea1 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:34.174177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 124/224] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:34.174830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42324d23-fca2-41f5-86c9-73fb42c5448b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:34.199493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806afc8f-0a91-4447-b059-c59014b8a801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:34.200726 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806afc8f-0a91-4447-b059-c59014b8a801 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:34.201203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806afc8f-0a91-4447-b059-c59014b8a801 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:34.201693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806afc8f-0a91-4447-b059-c59014b8a801 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:34.203063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806afc8f-0a91-4447-b059-c59014b8a801 None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:34.204974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806afc8f-0a91-4447-b059-c59014b8a801 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:34.207279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 101/225] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:34 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:34.213015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806afc8f-0a91-4447-b059-c59014b8a801 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:34.274931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42324d23-fca2-41f5-86c9-73fb42c5448b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:34.311117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5530e-2cc1-4ea6-ab96-16f2ef990ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:34.311914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5530e-2cc1-4ea6-ab96-16f2ef990ecc None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:34.312217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5530e-2cc1-4ea6-ab96-16f2ef990ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:34.312521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5530e-2cc1-4ea6-ab96-16f2ef990ecc None admin] PATH_INFO: `/v3/users/02e8fbca83d74332a610a95cfda2cc0f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:34.314486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5530e-2cc1-4ea6-ab96-16f2ef990ecc None admin] RBAC: Authorizing `identity:get_user(user_id=02e8fbca83d74332a610a95cfda2cc0f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:34.315936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5530e-2cc1-4ea6-ab96-16f2ef990ecc None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:34.317603 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 125/226] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:34 2022] GET /identity/v3/users/02e8fbca83d74332a610a95cfda2cc0f => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:34.322321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5530e-2cc1-4ea6-ab96-16f2ef990ecc None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:34.322571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806afc8f-0a91-4447-b059-c59014b8a801 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:34.368053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18abce-252e-4ab9-b3c1-95ec0b10c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:34.369098 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18abce-252e-4ab9-b3c1-95ec0b10c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:34.369576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18abce-252e-4ab9-b3c1-95ec0b10c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:34.370043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18abce-252e-4ab9-b3c1-95ec0b10c0a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:34.371096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18abce-252e-4ab9-b3c1-95ec0b10c0a7 None admin] RBAC: Adding query filter params (role.id=1ead91d8230c468cabd0637c833c42ac, scope.project.id=83915a029ef141e7a371da8296ea927d, user.id=c7521d8b01864bb7a6c20a8ce347d86e) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:34.372041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18abce-252e-4ab9-b3c1-95ec0b10c0a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:34.374068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18abce-252e-4ab9-b3c1-95ec0b10c0a7 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:34.381934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 102/227] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:34 2022] GET /identity/v3/role_assignments?user.id=c7521d8b01864bb7a6c20a8ce347d86e&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=1ead91d8230c468cabd0637c833c42ac => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:34.389789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18abce-252e-4ab9-b3c1-95ec0b10c0a7 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:34.494242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5530e-2cc1-4ea6-ab96-16f2ef990ecc None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:34.535559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18abce-252e-4ab9-b3c1-95ec0b10c0a7 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:34.574827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9fd65-4287-46d2-a409-4ab99cc94d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:34.575559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9fd65-4287-46d2-a409-4ab99cc94d8b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:34.575841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9fd65-4287-46d2-a409-4ab99cc94d8b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:34.576114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9fd65-4287-46d2-a409-4ab99cc94d8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:34.594309 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ba80d-1092-4ea5-b3e8-134e0fb37955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:34.595206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ba80d-1092-4ea5-b3e8-134e0fb37955 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:34.595491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ba80d-1092-4ea5-b3e8-134e0fb37955 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:34.595769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ba80d-1092-4ea5-b3e8-134e0fb37955 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:34.597105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ba80d-1092-4ea5-b3e8-134e0fb37955 None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:34.598563 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ba80d-1092-4ea5-b3e8-134e0fb37955 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:34.600498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 103/228] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:34 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:34.605716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9fd65-4287-46d2-a409-4ab99cc94d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:34.606453 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ba80d-1092-4ea5-b3e8-134e0fb37955 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-86a9fd65-4287-46d2-a409-4ab99cc94d8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:34.615196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:34.616097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:34.616889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 126/229] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:34.621695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9fd65-4287-46d2-a409-4ab99cc94d8b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:34.736521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ba80d-1092-4ea5-b3e8-134e0fb37955 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:34.784049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9845c82-27b9-4088-9ffb-9527c892baed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:34.785100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9845c82-27b9-4088-9ffb-9527c892baed None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:34.785386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9845c82-27b9-4088-9ffb-9527c892baed None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:34.785663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9845c82-27b9-4088-9ffb-9527c892baed None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d/users/02e8fbca83d74332a610a95cfda2cc0f/roles/297b3b3e5982438e9af6c05761718fcc` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:34.790235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9845c82-27b9-4088-9ffb-9527c892baed None admin] RBAC: Authorizing `identity:create_grant(project_id=83915a029ef141e7a371da8296ea927d, user_id=02e8fbca83d74332a610a95cfda2cc0f, role_id=297b3b3e5982438e9af6c05761718fcc)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:34.791703 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9845c82-27b9-4088-9ffb-9527c892baed None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:34.806163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9fd65-4287-46d2-a409-4ab99cc94d8b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:34.821244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 104/230] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:52:34 2022] PUT /identity/v3/projects/83915a029ef141e7a371da8296ea927d/users/02e8fbca83d74332a610a95cfda2cc0f/roles/297b3b3e5982438e9af6c05761718fcc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 11:52:34.855995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cbe74-7eae-4b10-8b77-a29c14e4caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:34.856630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cbe74-7eae-4b10-8b77-a29c14e4caa8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:34.856923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cbe74-7eae-4b10-8b77-a29c14e4caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:34.857207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cbe74-7eae-4b10-8b77-a29c14e4caa8 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:34.857979 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cbe74-7eae-4b10-8b77-a29c14e4caa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:34.858321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cbe74-7eae-4b10-8b77-a29c14e4caa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:34.860011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cbe74-7eae-4b10-8b77-a29c14e4caa8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:34.869265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 127/231] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:34.875651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9845c82-27b9-4088-9ffb-9527c892baed None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:35.014554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9845c82-27b9-4088-9ffb-9527c892baed None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:35.064594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c434-d5ab-424d-b0d5-9e27c3bc9b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:35.065501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c434-d5ab-424d-b0d5-9e27c3bc9b7d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:35.065783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c434-d5ab-424d-b0d5-9e27c3bc9b7d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:35.066057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c434-d5ab-424d-b0d5-9e27c3bc9b7d None admin] PATH_INFO: `/v3/users/02e8fbca83d74332a610a95cfda2cc0f` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:35.067364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c434-d5ab-424d-b0d5-9e27c3bc9b7d None admin] RBAC: Authorizing `identity:get_user(user_id=02e8fbca83d74332a610a95cfda2cc0f)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:35.068883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c434-d5ab-424d-b0d5-9e27c3bc9b7d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:35.070621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 105/232] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:34 2022] GET /identity/v3/users/02e8fbca83d74332a610a95cfda2cc0f => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:35.076264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cbe74-7eae-4b10-8b77-a29c14e4caa8 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:35.195579 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cbe74-7eae-4b10-8b77-a29c14e4caa8 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:35.237565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27475fa1-0d60-402e-914a-df5c35538c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:35.238430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27475fa1-0d60-402e-914a-df5c35538c7b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:35.239604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27475fa1-0d60-402e-914a-df5c35538c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:35.239604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27475fa1-0d60-402e-914a-df5c35538c7b None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:35.240147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27475fa1-0d60-402e-914a-df5c35538c7b None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:35.242607 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27475fa1-0d60-402e-914a-df5c35538c7b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:35.244807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 128/233] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:35 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:35.249911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c434-d5ab-424d-b0d5-9e27c3bc9b7d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:35.383952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c434-d5ab-424d-b0d5-9e27c3bc9b7d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:35.424385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200c75c-aa65-4b42-812e-7c2b8c4442c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:35.425290 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c75c-aa65-4b42-812e-7c2b8c4442c7 None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:35.425574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c75c-aa65-4b42-812e-7c2b8c4442c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:35.425851 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c75c-aa65-4b42-812e-7c2b8c4442c7 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d/users/02e8fbca83d74332a610a95cfda2cc0f/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:35.427873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200c75c-aa65-4b42-812e-7c2b8c4442c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=83915a029ef141e7a371da8296ea927d, user_id=02e8fbca83d74332a610a95cfda2cc0f, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:35.429347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200c75c-aa65-4b42-812e-7c2b8c4442c7 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:35.456762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 106/234] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:52:35 2022] PUT /identity/v3/projects/83915a029ef141e7a371da8296ea927d/users/02e8fbca83d74332a610a95cfda2cc0f/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:36.267498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddabf66-9a0c-479a-86fe-066cd93826dd None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:36.268217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddabf66-9a0c-479a-86fe-066cd93826dd None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:36.268217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddabf66-9a0c-479a-86fe-066cd93826dd None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:36.269715 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 129/235] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:36.274852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29438fdc-843e-4cb0-91af-b5fc7c9adeb1 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:36.275662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29438fdc-843e-4cb0-91af-b5fc7c9adeb1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:36.276133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29438fdc-843e-4cb0-91af-b5fc7c9adeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:36.293687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-29438fdc-843e-4cb0-91af-b5fc7c9adeb1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:36.295153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-29438fdc-843e-4cb0-91af-b5fc7c9adeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:36.355409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e91d6-e61e-4ca1-8ac4-1e89e6e6d492 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:36.356023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e91d6-e61e-4ca1-8ac4-1e89e6e6d492 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:36.356536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e91d6-e61e-4ca1-8ac4-1e89e6e6d492 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:36.358196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 130/236] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:36.363015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 107/237] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:36.364651 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a84ae-56f6-48c0-97ce-92d3fc902b5c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:36.365162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a84ae-56f6-48c0-97ce-92d3fc902b5c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:36.365630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a84ae-56f6-48c0-97ce-92d3fc902b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:36.385903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29438fdc-843e-4cb0-91af-b5fc7c9adeb1 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:36.405304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-6e3a84ae-56f6-48c0-97ce-92d3fc902b5c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:36.407278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6e3a84ae-56f6-48c0-97ce-92d3fc902b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:36.490848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29438fdc-843e-4cb0-91af-b5fc7c9adeb1 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:36.502482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 131/238] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:36.537655 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dc5f5-4499-4349-b052-f1c6feea14c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:36.538811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dc5f5-4499-4349-b052-f1c6feea14c5 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:36.539307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dc5f5-4499-4349-b052-f1c6feea14c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:36.539774 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dc5f5-4499-4349-b052-f1c6feea14c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:36.545997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a84ae-56f6-48c0-97ce-92d3fc902b5c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:36.551797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8dc5f5-4499-4349-b052-f1c6feea14c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-5b8dc5f5-4499-4349-b052-f1c6feea14c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:36.559940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:36.560875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:36.561642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:36.563620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 108/239] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:36.569207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dc5f5-4499-4349-b052-f1c6feea14c5 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:36.668219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a84ae-56f6-48c0-97ce-92d3fc902b5c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:36.698059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5ea6-344e-462f-8a44-61b1b4a12ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:36.699049 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5ea6-344e-462f-8a44-61b1b4a12ad3 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:36.699429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5ea6-344e-462f-8a44-61b1b4a12ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:36.699799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5ea6-344e-462f-8a44-61b1b4a12ad3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:36.701100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5ea6-344e-462f-8a44-61b1b4a12ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:36.702929 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5ea6-344e-462f-8a44-61b1b4a12ad3 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:36.705344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 132/240] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:36.713146 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5ea6-344e-462f-8a44-61b1b4a12ad3 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:36.734076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dc5f5-4499-4349-b052-f1c6feea14c5 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:36.769298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62afc5d-66a5-4688-ad03-ddecc530cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:36.770340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62afc5d-66a5-4688-ad03-ddecc530cce1 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:36.770813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62afc5d-66a5-4688-ad03-ddecc530cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:36.771278 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62afc5d-66a5-4688-ad03-ddecc530cce1 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:36.772234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62afc5d-66a5-4688-ad03-ddecc530cce1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:36.772736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62afc5d-66a5-4688-ad03-ddecc530cce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:36.774326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62afc5d-66a5-4688-ad03-ddecc530cce1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:36.783401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 109/241] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:36.788933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62afc5d-66a5-4688-ad03-ddecc530cce1 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:36.890095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62afc5d-66a5-4688-ad03-ddecc530cce1 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:36.924624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002212d3-b051-4f53-9521-d6e24878d805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:36.925851 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002212d3-b051-4f53-9521-d6e24878d805 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:36.926322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002212d3-b051-4f53-9521-d6e24878d805 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:36.926786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002212d3-b051-4f53-9521-d6e24878d805 None admin] PATH_INFO: `/v3/users/764f303d8dfb4448950993905627f5b3` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:36.936142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5ea6-344e-462f-8a44-61b1b4a12ad3 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:36.941913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002212d3-b051-4f53-9521-d6e24878d805 None admin] RBAC: Authorizing `identity:get_user(user_id=764f303d8dfb4448950993905627f5b3)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:36.943805 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002212d3-b051-4f53-9521-d6e24878d805 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:36.946314 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 110/242] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:36 2022] GET /identity/v3/users/764f303d8dfb4448950993905627f5b3 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:36.951794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002212d3-b051-4f53-9521-d6e24878d805 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:37.041031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471113b3-67cd-4984-9d61-df66cd5cf5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:37.041592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471113b3-67cd-4984-9d61-df66cd5cf5e2 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:37.041882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471113b3-67cd-4984-9d61-df66cd5cf5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:37.042167 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471113b3-67cd-4984-9d61-df66cd5cf5e2 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:37.042935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471113b3-67cd-4984-9d61-df66cd5cf5e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:37.044372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471113b3-67cd-4984-9d61-df66cd5cf5e2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:37.058861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002212d3-b051-4f53-9521-d6e24878d805 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:37.097916 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0620b-25e3-4892-a60c-7b9c0b4cf19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:37.099683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0620b-25e3-4892-a60c-7b9c0b4cf19a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:37.100301 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0620b-25e3-4892-a60c-7b9c0b4cf19a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:37.101777 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0620b-25e3-4892-a60c-7b9c0b4cf19a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:37.108143 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 133/243] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:52:36 2022] POST /identity/v3/users => generated 293 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:37.180966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0620b-25e3-4892-a60c-7b9c0b4cf19a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:37.182827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0620b-25e3-4892-a60c-7b9c0b4cf19a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:37.206475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abd622-5668-4071-be4d-cbe42c60cde9 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:37.207098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abd622-5668-4071-be4d-cbe42c60cde9 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:37.207615 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abd622-5668-4071-be4d-cbe42c60cde9 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:37.209406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 134/244] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:37.221018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcfb8c-1ba8-42ff-b2fe-126c1ece0dce None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:37.221332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcfb8c-1ba8-42ff-b2fe-126c1ece0dce None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:37.221586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcfb8c-1ba8-42ff-b2fe-126c1ece0dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:37.258829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-0efcfb8c-1ba8-42ff-b2fe-126c1ece0dce None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:37.260067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0efcfb8c-1ba8-42ff-b2fe-126c1ece0dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:37.384418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 111/245] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 11:52:37.386880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 135/246] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:37.392129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0620b-25e3-4892-a60c-7b9c0b4cf19a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:37.412559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcfb8c-1ba8-42ff-b2fe-126c1ece0dce None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:37.507435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0620b-25e3-4892-a60c-7b9c0b4cf19a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:37.518691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcfb8c-1ba8-42ff-b2fe-126c1ece0dce None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:37.549714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e40c9b-3421-4d79-8410-df7b865889a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:37.550901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40c9b-3421-4d79-8410-df7b865889a5 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:37.551356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40c9b-3421-4d79-8410-df7b865889a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:37.551826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40c9b-3421-4d79-8410-df7b865889a5 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:37.553358 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e40c9b-3421-4d79-8410-df7b865889a5 None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:37.555099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e40c9b-3421-4d79-8410-df7b865889a5 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:37.557489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 112/247] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:37 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:37.559600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59161b-41e2-45c3-9931-1b6bca4318ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:37.562476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59161b-41e2-45c3-9931-1b6bca4318ad None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:37.562476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59161b-41e2-45c3-9931-1b6bca4318ad None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:37.562476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59161b-41e2-45c3-9931-1b6bca4318ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:37.565539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e40c9b-3421-4d79-8410-df7b865889a5 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:37.578017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59161b-41e2-45c3-9931-1b6bca4318ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-8e59161b-41e2-45c3-9931-1b6bca4318ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:37.588733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:37.589613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:37.590391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 136/248] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:37.598544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59161b-41e2-45c3-9931-1b6bca4318ad None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:37.716505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e40c9b-3421-4d79-8410-df7b865889a5 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:37.726878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59161b-41e2-45c3-9931-1b6bca4318ad None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:37.763042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9246df-12b4-42a8-a4fe-82510c44dcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:37.763703 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9246df-12b4-42a8-a4fe-82510c44dcea None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:37.763986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9246df-12b4-42a8-a4fe-82510c44dcea None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:37.764345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9246df-12b4-42a8-a4fe-82510c44dcea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:37.765194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9246df-12b4-42a8-a4fe-82510c44dcea None admin] RBAC: Adding query filter params (role.id=771bd64f51c4466a934ee622fea6214f, scope.project.id=83915a029ef141e7a371da8296ea927d, user.id=764f303d8dfb4448950993905627f5b3) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:37.765507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9246df-12b4-42a8-a4fe-82510c44dcea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:37.767165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9246df-12b4-42a8-a4fe-82510c44dcea None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:37.771216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5688eb-13c3-4e48-9721-dd95f7c94244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:37.771890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5688eb-13c3-4e48-9721-dd95f7c94244 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:37.772292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5688eb-13c3-4e48-9721-dd95f7c94244 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:37.772538 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5688eb-13c3-4e48-9721-dd95f7c94244 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:37.773213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5688eb-13c3-4e48-9721-dd95f7c94244 None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:37.773527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5688eb-13c3-4e48-9721-dd95f7c94244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:37.774148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 113/249] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:37 2022] GET /identity/v3/role_assignments?user.id=764f303d8dfb4448950993905627f5b3&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=771bd64f51c4466a934ee622fea6214f => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:37.775216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5688eb-13c3-4e48-9721-dd95f7c94244 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:37.775495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc968cc4-2c9d-46de-b7d8-75d086bebe8b None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:37.775788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc968cc4-2c9d-46de-b7d8-75d086bebe8b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:37.776066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc968cc4-2c9d-46de-b7d8-75d086bebe8b None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:37.782861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 114/250] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:37.785662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 137/251] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:37.791448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc968cc4-2c9d-46de-b7d8-75d086bebe8b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:37.794984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7d24-d79c-417d-a355-594a3e8cea7e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:37.795393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7d24-d79c-417d-a355-594a3e8cea7e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:37.795900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d7d24-d79c-417d-a355-594a3e8cea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:37.817027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1e1d7d24-d79c-417d-a355-594a3e8cea7e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:37.818192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1e1d7d24-d79c-417d-a355-594a3e8cea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:37.900559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 138/252] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:37.926032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc968cc4-2c9d-46de-b7d8-75d086bebe8b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:37.944597 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d7d24-d79c-417d-a355-594a3e8cea7e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:37.964217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eeb3d-0bd7-4ad7-9b0e-9d78f1279aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:37.965027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eeb3d-0bd7-4ad7-9b0e-9d78f1279aa8 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:37.965303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eeb3d-0bd7-4ad7-9b0e-9d78f1279aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:37.965571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eeb3d-0bd7-4ad7-9b0e-9d78f1279aa8 None admin] PATH_INFO: `/v3/users/c7521d8b01864bb7a6c20a8ce347d86e` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:37.966869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eeb3d-0bd7-4ad7-9b0e-9d78f1279aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=c7521d8b01864bb7a6c20a8ce347d86e)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:37.968362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eeb3d-0bd7-4ad7-9b0e-9d78f1279aa8 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:37.970480 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 115/253] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:37 2022] GET /identity/v3/users/c7521d8b01864bb7a6c20a8ce347d86e => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:37.975975 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eeb3d-0bd7-4ad7-9b0e-9d78f1279aa8 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:38.088567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eeb3d-0bd7-4ad7-9b0e-9d78f1279aa8 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:38.113668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d7d24-d79c-417d-a355-594a3e8cea7e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:38.117534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34915de-b2cd-4e59-bed2-25a5657ce56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:38.118239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34915de-b2cd-4e59-bed2-25a5657ce56e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:38.118515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34915de-b2cd-4e59-bed2-25a5657ce56e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:38.118789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34915de-b2cd-4e59-bed2-25a5657ce56e None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:38.123414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34915de-b2cd-4e59-bed2-25a5657ce56e None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:38.123414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34915de-b2cd-4e59-bed2-25a5657ce56e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:38.123414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 116/254] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:37 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:38.134810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34915de-b2cd-4e59-bed2-25a5657ce56e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:38.188195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b12635-0be8-4d47-a6d8-075b78a9f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:38.189074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b12635-0be8-4d47-a6d8-075b78a9f625 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:38.189437 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b12635-0be8-4d47-a6d8-075b78a9f625 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:38.189764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b12635-0be8-4d47-a6d8-075b78a9f625 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:38.215117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b12635-0be8-4d47-a6d8-075b78a9f625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-a5b12635-0be8-4d47-a6d8-075b78a9f625 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:38.232763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:38.233659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:38.236079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 139/255] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:52:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:38.240160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b12635-0be8-4d47-a6d8-075b78a9f625 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:38.310535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34915de-b2cd-4e59-bed2-25a5657ce56e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:38.352951 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b2d5-85b1-4661-854d-44fe170d656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:38.353840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b2d5-85b1-4661-854d-44fe170d656b None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:38.354116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b2d5-85b1-4661-854d-44fe170d656b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:38.354388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b2d5-85b1-4661-854d-44fe170d656b None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d/users/c7521d8b01864bb7a6c20a8ce347d86e/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:38.358926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263b2d5-85b1-4661-854d-44fe170d656b None admin] RBAC: Authorizing `identity:create_grant(project_id=83915a029ef141e7a371da8296ea927d, user_id=c7521d8b01864bb7a6c20a8ce347d86e, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:38.361538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263b2d5-85b1-4661-854d-44fe170d656b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:38.390109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 117/256] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:52:38 2022] PUT /identity/v3/projects/83915a029ef141e7a371da8296ea927d/users/c7521d8b01864bb7a6c20a8ce347d86e/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:38.416798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b12635-0be8-4d47-a6d8-075b78a9f625 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:38.458476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c7238-f63a-4537-8d63-95f5f4d337c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:38.459158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7238-f63a-4537-8d63-95f5f4d337c6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:38.459438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7238-f63a-4537-8d63-95f5f4d337c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:38.459709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7238-f63a-4537-8d63-95f5f4d337c6 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:38.460489 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c7238-f63a-4537-8d63-95f5f4d337c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:38.460797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c7238-f63a-4537-8d63-95f5f4d337c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:38.462194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c7238-f63a-4537-8d63-95f5f4d337c6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:38.476733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 140/257] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:52:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:38.482582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b2d5-85b1-4661-854d-44fe170d656b None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:38.503204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0dcc3-c508-4e2b-ba4f-fe883a7db5b7 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:38.503491 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0dcc3-c508-4e2b-ba4f-fe883a7db5b7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:38.503741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0dcc3-c508-4e2b-ba4f-fe883a7db5b7 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:38.505129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 141/258] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:38.515347 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdba33-ae23-4156-9c52-ac2011d00ce1 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:38.516223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdba33-ae23-4156-9c52-ac2011d00ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:38.516462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdba33-ae23-4156-9c52-ac2011d00ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:38.549409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a3fdba33-ae23-4156-9c52-ac2011d00ce1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:38.554808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a3fdba33-ae23-4156-9c52-ac2011d00ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:38.699312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b2d5-85b1-4661-854d-44fe170d656b None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:38.704311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 142/259] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:38.743345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdba33-ae23-4156-9c52-ac2011d00ce1 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:38.757136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e4c7e-bff8-4d2f-8e44-2ecb4593da6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:38.758276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e4c7e-bff8-4d2f-8e44-2ecb4593da6f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:38.758712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e4c7e-bff8-4d2f-8e44-2ecb4593da6f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:38.759124 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e4c7e-bff8-4d2f-8e44-2ecb4593da6f None admin] PATH_INFO: `/v3/users/02e8fbca83d74332a610a95cfda2cc0f` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:38.760554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e4c7e-bff8-4d2f-8e44-2ecb4593da6f None admin] RBAC: Authorizing `identity:get_user(user_id=02e8fbca83d74332a610a95cfda2cc0f)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:38.762148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e4c7e-bff8-4d2f-8e44-2ecb4593da6f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:38.764316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 118/260] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:38 2022] GET /identity/v3/users/02e8fbca83d74332a610a95cfda2cc0f => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:38.769782 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e4c7e-bff8-4d2f-8e44-2ecb4593da6f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:38.938162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdba33-ae23-4156-9c52-ac2011d00ce1 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:38.959932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e4c7e-bff8-4d2f-8e44-2ecb4593da6f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:39.004281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83599ef-5294-4d0e-8a97-a8f2a37e34a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:39.005079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83599ef-5294-4d0e-8a97-a8f2a37e34a9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:39.005357 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83599ef-5294-4d0e-8a97-a8f2a37e34a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:39.005625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83599ef-5294-4d0e-8a97-a8f2a37e34a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:39.023973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83599ef-5294-4d0e-8a97-a8f2a37e34a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-a83599ef-5294-4d0e-8a97-a8f2a37e34a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:39.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:39.032705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:39.033624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:39.034339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9600cf-e18a-4b83-ba3a-fe1ceb7aeadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:39.037659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9600cf-e18a-4b83-ba3a-fe1ceb7aeadb None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:39.037659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9600cf-e18a-4b83-ba3a-fe1ceb7aeadb None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:39.037659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9600cf-e18a-4b83-ba3a-fe1ceb7aeadb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:39.044922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 143/261] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:39.051224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83599ef-5294-4d0e-8a97-a8f2a37e34a9 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:39.156229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9600cf-e18a-4b83-ba3a-fe1ceb7aeadb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:39.157891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9600cf-e18a-4b83-ba3a-fe1ceb7aeadb None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:39.274173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83599ef-5294-4d0e-8a97-a8f2a37e34a9 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:39.279252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 119/262] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 11:52:39.285040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9600cf-e18a-4b83-ba3a-fe1ceb7aeadb None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:39.369688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fa00a-baee-47b4-93d0-c070601fae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:39.370376 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fa00a-baee-47b4-93d0-c070601fae22 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:39.370661 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fa00a-baee-47b4-93d0-c070601fae22 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:39.370933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fa00a-baee-47b4-93d0-c070601fae22 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:39.371689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fa00a-baee-47b4-93d0-c070601fae22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:39.371995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fa00a-baee-47b4-93d0-c070601fae22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:39.373412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fa00a-baee-47b4-93d0-c070601fae22 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:39.391367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 144/263] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:39.401265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9600cf-e18a-4b83-ba3a-fe1ceb7aeadb None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:39.413936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fa00a-baee-47b4-93d0-c070601fae22 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:39.442399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263289ed-9638-4b53-8ca7-2c21eae539de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:39.443285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263289ed-9638-4b53-8ca7-2c21eae539de None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:39.443731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263289ed-9638-4b53-8ca7-2c21eae539de None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:39.444019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263289ed-9638-4b53-8ca7-2c21eae539de None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:39.445443 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263289ed-9638-4b53-8ca7-2c21eae539de None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:39.446974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263289ed-9638-4b53-8ca7-2c21eae539de None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:39.449578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 120/264] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:39 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:39.455834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263289ed-9638-4b53-8ca7-2c21eae539de None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:39.585524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fa00a-baee-47b4-93d0-c070601fae22 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:39.620483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7c348-bcc9-4abd-877a-8ca27c44e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:39.621373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7c348-bcc9-4abd-877a-8ca27c44e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:39.621709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7c348-bcc9-4abd-877a-8ca27c44e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:39.621990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7c348-bcc9-4abd-877a-8ca27c44e8f3 None admin] PATH_INFO: `/v3/users/02e8fbca83d74332a610a95cfda2cc0f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:39.623192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7c348-bcc9-4abd-877a-8ca27c44e8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=02e8fbca83d74332a610a95cfda2cc0f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:39.624726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7c348-bcc9-4abd-877a-8ca27c44e8f3 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:39.627040 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 145/265] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:39 2022] GET /identity/v3/users/02e8fbca83d74332a610a95cfda2cc0f => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:39.637159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7c348-bcc9-4abd-877a-8ca27c44e8f3 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:39.678311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263289ed-9638-4b53-8ca7-2c21eae539de None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:39.746765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7c348-bcc9-4abd-877a-8ca27c44e8f3 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:39.773529 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a6148-79f6-4c53-b6c2-d1a834c0b958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:39.774217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a6148-79f6-4c53-b6c2-d1a834c0b958 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:39.774499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a6148-79f6-4c53-b6c2-d1a834c0b958 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:39.774768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a6148-79f6-4c53-b6c2-d1a834c0b958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:39.775629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a6148-79f6-4c53-b6c2-d1a834c0b958 None admin] RBAC: Adding query filter params (role.id=297b3b3e5982438e9af6c05761718fcc, scope.project.id=83915a029ef141e7a371da8296ea927d, user.id=02e8fbca83d74332a610a95cfda2cc0f) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:39.775938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a6148-79f6-4c53-b6c2-d1a834c0b958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:39.777463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a6148-79f6-4c53-b6c2-d1a834c0b958 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:39.783121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9e7f2-124d-4e73-a90c-31c82b61f30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:39.783721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9e7f2-124d-4e73-a90c-31c82b61f30f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:39.784011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9e7f2-124d-4e73-a90c-31c82b61f30f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:39.784368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9e7f2-124d-4e73-a90c-31c82b61f30f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:39.794482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 121/266] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:39 2022] GET /identity/v3/role_assignments?user.id=02e8fbca83d74332a610a95cfda2cc0f&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=297b3b3e5982438e9af6c05761718fcc => generated 608 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:39.858087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9e7f2-124d-4e73-a90c-31c82b61f30f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:39.860250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9e7f2-124d-4e73-a90c-31c82b61f30f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:39.966160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 146/267] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:39.973094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a6148-79f6-4c53-b6c2-d1a834c0b958 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:40.136206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a6148-79f6-4c53-b6c2-d1a834c0b958 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:40.181218 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b70a36-55ce-4f1a-9521-c60b8c3228dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:40.182079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b70a36-55ce-4f1a-9521-c60b8c3228dc None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:40.182359 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b70a36-55ce-4f1a-9521-c60b8c3228dc None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:40.182632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b70a36-55ce-4f1a-9521-c60b8c3228dc None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:40.189360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b70a36-55ce-4f1a-9521-c60b8c3228dc None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:40.190837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b70a36-55ce-4f1a-9521-c60b8c3228dc None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:40.192984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 122/268] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:39 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:40.198690 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9e7f2-124d-4e73-a90c-31c82b61f30f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:40.306923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9e7f2-124d-4e73-a90c-31c82b61f30f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:40.345982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c8cc5-cd0e-47ee-b3b8-2306c995e57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:40.346653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c8cc5-cd0e-47ee-b3b8-2306c995e57e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:40.346941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c8cc5-cd0e-47ee-b3b8-2306c995e57e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:40.347222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c8cc5-cd0e-47ee-b3b8-2306c995e57e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:40.348119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c8cc5-cd0e-47ee-b3b8-2306c995e57e None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=83915a029ef141e7a371da8296ea927d, user.id=02e8fbca83d74332a610a95cfda2cc0f) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:40.348464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c8cc5-cd0e-47ee-b3b8-2306c995e57e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:40.349963 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c8cc5-cd0e-47ee-b3b8-2306c995e57e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:40.360550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 147/269] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:40 2022] GET /identity/v3/role_assignments?user.id=02e8fbca83d74332a610a95cfda2cc0f&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=3db33dfd3d6544fd81933007633fc56a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:40.800556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f58c-5251-4f1b-a334-0e82fcae4785 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:40.801526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f58c-5251-4f1b-a334-0e82fcae4785 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:40.802111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f58c-5251-4f1b-a334-0e82fcae4785 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:40.803955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 123/270] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:40.809288 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc89a-548c-4b90-b103-8c93cdc14db9 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:40.809698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc89a-548c-4b90-b103-8c93cdc14db9 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:40.810134 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc89a-548c-4b90-b103-8c93cdc14db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:40.827619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-191bc89a-548c-4b90-b103-8c93cdc14db9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:40.828902 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-191bc89a-548c-4b90-b103-8c93cdc14db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:40.854059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd82de6-5a16-4e07-bc98-b7a83282b147 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:40.854651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd82de6-5a16-4e07-bc98-b7a83282b147 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:40.855115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd82de6-5a16-4e07-bc98-b7a83282b147 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:40.856923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 124/271] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:40.864027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d2cb-6a3c-4f2e-8ff7-ca0b651d8c35 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:40.864660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d2cb-6a3c-4f2e-8ff7-ca0b651d8c35 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:40.865162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d2cb-6a3c-4f2e-8ff7-ca0b651d8c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:40.891343 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-1f50d2cb-6a3c-4f2e-8ff7-ca0b651d8c35 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:40.893020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1f50d2cb-6a3c-4f2e-8ff7-ca0b651d8c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:40.908102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 148/272] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:40.934411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bc89a-548c-4b90-b103-8c93cdc14db9 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:40.981432 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 125/273] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:41.005170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50d2cb-6a3c-4f2e-8ff7-ca0b651d8c35 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:41.034940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bc89a-548c-4b90-b103-8c93cdc14db9 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:41.069364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9285777-9edf-47c4-a8d7-1253c381f7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:41.070070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285777-9edf-47c4-a8d7-1253c381f7ab None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.070343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285777-9edf-47c4-a8d7-1253c381f7ab None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.070616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285777-9edf-47c4-a8d7-1253c381f7ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.086100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9285777-9edf-47c4-a8d7-1253c381f7ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-d9285777-9edf-47c4-a8d7-1253c381f7ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:41.094414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:41.095295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:41.096045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 149/274] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:41.097144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266f813-0103-4c9f-8aa7-291e97727d19 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.097368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266f813-0103-4c9f-8aa7-291e97727d19 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.097856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266f813-0103-4c9f-8aa7-291e97727d19 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.099036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 150/275] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:41.104093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266f813-0103-4c9f-8aa7-291e97727d19 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:41.123160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50d2cb-6a3c-4f2e-8ff7-ca0b651d8c35 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:41.156735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cce968-ca4a-48bd-8d15-1dbdabd8a930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:41.157523 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cce968-ca4a-48bd-8d15-1dbdabd8a930 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.157801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cce968-ca4a-48bd-8d15-1dbdabd8a930 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.158071 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cce968-ca4a-48bd-8d15-1dbdabd8a930 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.159235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cce968-ca4a-48bd-8d15-1dbdabd8a930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:41.160719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cce968-ca4a-48bd-8d15-1dbdabd8a930 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:41.162323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 126/276] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:41.165418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60576b5-ee8d-451b-90bc-19808f80e4c7 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.166000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60576b5-ee8d-451b-90bc-19808f80e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.167400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60576b5-ee8d-451b-90bc-19808f80e4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.184217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f60576b5-ee8d-451b-90bc-19808f80e4c7 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:41.185813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f60576b5-ee8d-451b-90bc-19808f80e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:41.206502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266f813-0103-4c9f-8aa7-291e97727d19 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:41.239959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351e683-dbd8-4666-820a-c8d1ca77f349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:41.240730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351e683-dbd8-4666-820a-c8d1ca77f349 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.241015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351e683-dbd8-4666-820a-c8d1ca77f349 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.241363 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351e683-dbd8-4666-820a-c8d1ca77f349 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.242106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351e683-dbd8-4666-820a-c8d1ca77f349 None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:41.242413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351e683-dbd8-4666-820a-c8d1ca77f349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:41.243802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351e683-dbd8-4666-820a-c8d1ca77f349 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:41.251960 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 127/277] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:41.253046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60576b5-ee8d-451b-90bc-19808f80e4c7 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:41.256867 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 151/278] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:41.257553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351e683-dbd8-4666-820a-c8d1ca77f349 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:41.355054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60576b5-ee8d-451b-90bc-19808f80e4c7 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:41.361212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351e683-dbd8-4666-820a-c8d1ca77f349 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:41.391165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec6681-ed4d-45e8-8cd3-3e99a2fada4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:41.391830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec6681-ed4d-45e8-8cd3-3e99a2fada4e None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.392108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec6681-ed4d-45e8-8cd3-3e99a2fada4e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.392407 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec6681-ed4d-45e8-8cd3-3e99a2fada4e None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.393114 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec6681-ed4d-45e8-8cd3-3e99a2fada4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:41.394482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cbc38-d653-47d0-ab03-6c9fb278ac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:41.394591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec6681-ed4d-45e8-8cd3-3e99a2fada4e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:41.395342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cbc38-d653-47d0-ab03-6c9fb278ac5f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.395626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cbc38-d653-47d0-ab03-6c9fb278ac5f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.395896 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cbc38-d653-47d0-ab03-6c9fb278ac5f None admin] PATH_INFO: `/v3/users/0f417d2f8492444cbb2ed8271bfb8ce4` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.410456 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cbc38-d653-47d0-ab03-6c9fb278ac5f None admin] RBAC: Authorizing `identity:get_user(user_id=0f417d2f8492444cbb2ed8271bfb8ce4)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:41.412014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cbc38-d653-47d0-ab03-6c9fb278ac5f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:41.418895 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 152/279] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:41 2022] GET /identity/v3/users/0f417d2f8492444cbb2ed8271bfb8ce4 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:41.418895 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cbc38-d653-47d0-ab03-6c9fb278ac5f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:41.419153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 128/280] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:52:41 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:41.425310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec6681-ed4d-45e8-8cd3-3e99a2fada4e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:41.537953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec6681-ed4d-45e8-8cd3-3e99a2fada4e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:41.543864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cbc38-d653-47d0-ab03-6c9fb278ac5f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:41.575134 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54464157-0ef8-4323-a568-6c2361119421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:41.575807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54464157-0ef8-4323-a568-6c2361119421 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.576090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54464157-0ef8-4323-a568-6c2361119421 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.576397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54464157-0ef8-4323-a568-6c2361119421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.577250 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54464157-0ef8-4323-a568-6c2361119421 None admin] RBAC: Adding query filter params (role.id=1ead91d8230c468cabd0637c833c42ac, user.id=0f417d2f8492444cbb2ed8271bfb8ce4, scope.system=all) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:41.577564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54464157-0ef8-4323-a568-6c2361119421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:41.579099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54464157-0ef8-4323-a568-6c2361119421 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:41.583626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec18221-188f-493d-9601-479081c8f059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:41.584775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18221-188f-493d-9601-479081c8f059 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.589803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 129/281] 10.222.0.58 () {56 vars in 1308 bytes} [Tue May 17 11:52:41 2022] GET /identity/v3/role_assignments?user.id=0f417d2f8492444cbb2ed8271bfb8ce4&scope.system=all&role.id=1ead91d8230c468cabd0637c833c42ac => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:41.589962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18221-188f-493d-9601-479081c8f059 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.589962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec18221-188f-493d-9601-479081c8f059 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.609285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec18221-188f-493d-9601-479081c8f059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-5ec18221-188f-493d-9601-479081c8f059 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:41.617887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:41.618873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:41.619638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 153/282] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:41.627828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54464157-0ef8-4323-a568-6c2361119421 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:41.737547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54464157-0ef8-4323-a568-6c2361119421 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:41.777200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4813803-79cc-4824-8546-522dfdc20d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:41.777953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4813803-79cc-4824-8546-522dfdc20d0d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.778236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4813803-79cc-4824-8546-522dfdc20d0d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.778508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4813803-79cc-4824-8546-522dfdc20d0d None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.779259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4813803-79cc-4824-8546-522dfdc20d0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:41.779565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4813803-79cc-4824-8546-522dfdc20d0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:41.780975 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4813803-79cc-4824-8546-522dfdc20d0d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:41.793422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 130/283] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:41.798979 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec18221-188f-493d-9601-479081c8f059 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:41.809551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bacdf6-21f3-4a11-946a-3867662a2c3f None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.810284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bacdf6-21f3-4a11-946a-3867662a2c3f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.810356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bacdf6-21f3-4a11-946a-3867662a2c3f None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.811974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 131/284] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:41.818326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23648fd-9f95-4d3c-b71f-8c1f05bde2ce None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.818609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23648fd-9f95-4d3c-b71f-8c1f05bde2ce None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.818886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23648fd-9f95-4d3c-b71f-8c1f05bde2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.838970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-c23648fd-9f95-4d3c-b71f-8c1f05bde2ce None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:41.840520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c23648fd-9f95-4d3c-b71f-8c1f05bde2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:41.912133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 132/285] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:41.921242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec18221-188f-493d-9601-479081c8f059 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:41.936769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23648fd-9f95-4d3c-b71f-8c1f05bde2ce None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:41.966538 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368419a-1047-4ae3-8769-dce6f7c741a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:41.968017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368419a-1047-4ae3-8769-dce6f7c741a9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:41.968564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368419a-1047-4ae3-8769-dce6f7c741a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:41.969313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368419a-1047-4ae3-8769-dce6f7c741a9 None admin] PATH_INFO: `/v3/users/764f303d8dfb4448950993905627f5b3` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:41.971413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368419a-1047-4ae3-8769-dce6f7c741a9 None admin] RBAC: Authorizing `identity:get_user(user_id=764f303d8dfb4448950993905627f5b3)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:41.973250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368419a-1047-4ae3-8769-dce6f7c741a9 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:41.975083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 154/286] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:41 2022] GET /identity/v3/users/764f303d8dfb4448950993905627f5b3 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:41.980559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368419a-1047-4ae3-8769-dce6f7c741a9 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:42.098653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23648fd-9f95-4d3c-b71f-8c1f05bde2ce None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:42.135144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dcbd5-e25d-4df0-aa69-d40ae2ae5341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:42.135993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dcbd5-e25d-4df0-aa69-d40ae2ae5341 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:42.136301 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dcbd5-e25d-4df0-aa69-d40ae2ae5341 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:42.140200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dcbd5-e25d-4df0-aa69-d40ae2ae5341 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:42.143350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368419a-1047-4ae3-8769-dce6f7c741a9 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:42.146932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dcbd5-e25d-4df0-aa69-d40ae2ae5341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-752dcbd5-e25d-4df0-aa69-d40ae2ae5341 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:42.154831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:42.155700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:42.156553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 133/287] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:42.161667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dcbd5-e25d-4df0-aa69-d40ae2ae5341 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:42.203674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39f27c-cb2a-407e-b8bd-3f2bedbf2866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:42.204574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39f27c-cb2a-407e-b8bd-3f2bedbf2866 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:42.204856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39f27c-cb2a-407e-b8bd-3f2bedbf2866 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:42.205132 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39f27c-cb2a-407e-b8bd-3f2bedbf2866 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:42.206367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39f27c-cb2a-407e-b8bd-3f2bedbf2866 None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:42.207819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39f27c-cb2a-407e-b8bd-3f2bedbf2866 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:42.210385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 155/288] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:41 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:42.216284 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39f27c-cb2a-407e-b8bd-3f2bedbf2866 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:42.353724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dcbd5-e25d-4df0-aa69-d40ae2ae5341 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:42.389278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39f27c-cb2a-407e-b8bd-3f2bedbf2866 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:42.418154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fada2fb-9fb8-45b0-9001-3f2a1ecbc7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:42.418828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fada2fb-9fb8-45b0-9001-3f2a1ecbc7ee None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:42.419106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fada2fb-9fb8-45b0-9001-3f2a1ecbc7ee None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:42.419376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fada2fb-9fb8-45b0-9001-3f2a1ecbc7ee None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:42.420127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fada2fb-9fb8-45b0-9001-3f2a1ecbc7ee None admin] RBAC: Adding query filter params (name=member) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:42.420460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fada2fb-9fb8-45b0-9001-3f2a1ecbc7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:42.421876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fada2fb-9fb8-45b0-9001-3f2a1ecbc7ee None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:42.438782 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 134/289] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:42.442986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fada2fb-9fb8-45b0-9001-3f2a1ecbc7ee None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:42.449592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1661d-e8c0-4b94-b042-c75a3ae72c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:42.450669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1661d-e8c0-4b94-b042-c75a3ae72c44 None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:42.450960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1661d-e8c0-4b94-b042-c75a3ae72c44 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:42.451239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1661d-e8c0-4b94-b042-c75a3ae72c44 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d/users/764f303d8dfb4448950993905627f5b3/roles/771bd64f51c4466a934ee622fea6214f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:42.461167 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1661d-e8c0-4b94-b042-c75a3ae72c44 None admin] RBAC: Authorizing `identity:create_grant(project_id=83915a029ef141e7a371da8296ea927d, user_id=764f303d8dfb4448950993905627f5b3, role_id=771bd64f51c4466a934ee622fea6214f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:42.462641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1661d-e8c0-4b94-b042-c75a3ae72c44 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:42.497482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 156/290] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:52:42 2022] PUT /identity/v3/projects/83915a029ef141e7a371da8296ea927d/users/764f303d8dfb4448950993905627f5b3/roles/771bd64f51c4466a934ee622fea6214f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:42.571863 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fada2fb-9fb8-45b0-9001-3f2a1ecbc7ee None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:42.611834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd252d-ac7c-4c27-a342-02ecd955e683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:42.612753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd252d-ac7c-4c27-a342-02ecd955e683 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:42.613038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd252d-ac7c-4c27-a342-02ecd955e683 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:42.613320 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd252d-ac7c-4c27-a342-02ecd955e683 None admin] PATH_INFO: `/v3/users/c7521d8b01864bb7a6c20a8ce347d86e` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:42.616973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd252d-ac7c-4c27-a342-02ecd955e683 None admin] RBAC: Authorizing `identity:get_user(user_id=c7521d8b01864bb7a6c20a8ce347d86e)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:42.618441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd252d-ac7c-4c27-a342-02ecd955e683 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:42.620609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 135/291] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:42 2022] GET /identity/v3/users/c7521d8b01864bb7a6c20a8ce347d86e => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:42.626666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1661d-e8c0-4b94-b042-c75a3ae72c44 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:42.777910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1661d-e8c0-4b94-b042-c75a3ae72c44 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:42.813811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750ac6b-dc55-4a71-9931-ecc0929bd9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:42.814524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750ac6b-dc55-4a71-9931-ecc0929bd9ae None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:42.814752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750ac6b-dc55-4a71-9931-ecc0929bd9ae None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:42.815016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750ac6b-dc55-4a71-9931-ecc0929bd9ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:42.889257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750ac6b-dc55-4a71-9931-ecc0929bd9ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:42.891247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750ac6b-dc55-4a71-9931-ecc0929bd9ae None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:43.012168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 157/292] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:43.017908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd252d-ac7c-4c27-a342-02ecd955e683 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:43.166927 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd252d-ac7c-4c27-a342-02ecd955e683 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:43.212426 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78071456-70c2-4b44-a8fb-82a158329905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:43.213721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071456-70c2-4b44-a8fb-82a158329905 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:43.214204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071456-70c2-4b44-a8fb-82a158329905 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:43.214665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071456-70c2-4b44-a8fb-82a158329905 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:43.220910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78071456-70c2-4b44-a8fb-82a158329905 None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:43.222593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78071456-70c2-4b44-a8fb-82a158329905 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:43.224825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 136/293] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:43 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:43.230235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750ac6b-dc55-4a71-9931-ecc0929bd9ae None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:43.385870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750ac6b-dc55-4a71-9931-ecc0929bd9ae None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:43.435097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c36f01-f752-4af9-aca0-0cda0547a4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:43.435708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c36f01-f752-4af9-aca0-0cda0547a4de None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:43.435998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c36f01-f752-4af9-aca0-0cda0547a4de None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:43.436309 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c36f01-f752-4af9-aca0-0cda0547a4de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:43.437152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c36f01-f752-4af9-aca0-0cda0547a4de None admin] RBAC: Adding query filter params (role.id=1ead91d8230c468cabd0637c833c42ac, scope.project.id=83915a029ef141e7a371da8296ea927d, user.id=c7521d8b01864bb7a6c20a8ce347d86e) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:43.438144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c36f01-f752-4af9-aca0-0cda0547a4de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:43.439763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c36f01-f752-4af9-aca0-0cda0547a4de None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:43.448917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 158/294] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:43 2022] GET /identity/v3/role_assignments?user.id=c7521d8b01864bb7a6c20a8ce347d86e&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=1ead91d8230c468cabd0637c833c42ac => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:44.200294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcc1e4-ce29-4c3a-8cb6-0febba476a7e None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.200806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcc1e4-ce29-4c3a-8cb6-0febba476a7e None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.200910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcc1e4-ce29-4c3a-8cb6-0febba476a7e None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.202473 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 137/295] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:44.208907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6076-9b1c-45d8-8558-f5c18c983646 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.209741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6076-9b1c-45d8-8558-f5c18c983646 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.210220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce6076-9b1c-45d8-8558-f5c18c983646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.232141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-46ce6076-9b1c-45d8-8558-f5c18c983646 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:44.233691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-46ce6076-9b1c-45d8-8558-f5c18c983646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:44.296437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbed7b-e9f0-46d1-8ce5-c2af26866929 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.297774 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbed7b-e9f0-46d1-8ce5-c2af26866929 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.298261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbed7b-e9f0-46d1-8ce5-c2af26866929 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.300131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 138/296] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:44.305879 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9e855-0830-475c-8894-52aca9e20b96 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.306169 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9e855-0830-475c-8894-52aca9e20b96 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.306698 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9e855-0830-475c-8894-52aca9e20b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.310905 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 159/297] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:44.325580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-b2f9e855-0830-475c-8894-52aca9e20b96 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:44.326888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b2f9e855-0830-475c-8894-52aca9e20b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:44.335006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce6076-9b1c-45d8-8558-f5c18c983646 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:44.400347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 139/298] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:44.400347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b2010-b38d-4fe5-8ba5-67e478802510 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.400347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b2010-b38d-4fe5-8ba5-67e478802510 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.400347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b2010-b38d-4fe5-8ba5-67e478802510 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.400347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 140/299] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:44.404281 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be53e-519e-4cff-9e29-c233e32fe73b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.404767 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be53e-519e-4cff-9e29-c233e32fe73b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.405215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be53e-519e-4cff-9e29-c233e32fe73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.421627 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-669be53e-519e-4cff-9e29-c233e32fe73b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:44.423503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-669be53e-519e-4cff-9e29-c233e32fe73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:44.440647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce6076-9b1c-45d8-8558-f5c18c983646 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:44.474679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e00ea9-8b94-40af-a17a-635540850400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:44.475394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00ea9-8b94-40af-a17a-635540850400 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.475679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00ea9-8b94-40af-a17a-635540850400 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.475957 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e00ea9-8b94-40af-a17a-635540850400 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.486919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e00ea9-8b94-40af-a17a-635540850400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:44.500208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 141/300] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:44.500208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669be53e-519e-4cff-9e29-c233e32fe73b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-20e00ea9-8b94-40af-a17a-635540850400 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:44.500459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:44.501260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 160/301] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:44.502030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e00ea9-8b94-40af-a17a-635540850400 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:44.607782 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669be53e-519e-4cff-9e29-c233e32fe73b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:44.610486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e00ea9-8b94-40af-a17a-635540850400 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:44.641469 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438fa6-c037-47d7-bb8c-eaad3f34e94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:44.642330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438fa6-c037-47d7-bb8c-eaad3f34e94e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.642619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438fa6-c037-47d7-bb8c-eaad3f34e94e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.642896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438fa6-c037-47d7-bb8c-eaad3f34e94e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.644066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03438fa6-c037-47d7-bb8c-eaad3f34e94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:44.644317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6f6a-0652-4c27-9811-ab3d07aa616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:44.644978 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6f6a-0652-4c27-9811-ab3d07aa616c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.645259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6f6a-0652-4c27-9811-ab3d07aa616c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.645533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6f6a-0652-4c27-9811-ab3d07aa616c None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.645622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03438fa6-c037-47d7-bb8c-eaad3f34e94e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:44.646270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb6f6a-0652-4c27-9811-ab3d07aa616c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:44.646584 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb6f6a-0652-4c27-9811-ab3d07aa616c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:44.651958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 142/302] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:44.652082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb6f6a-0652-4c27-9811-ab3d07aa616c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:44.652155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438fa6-c037-47d7-bb8c-eaad3f34e94e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:44.657140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 161/303] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:44.657960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6f6a-0652-4c27-9811-ab3d07aa616c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:44.752327 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438fa6-c037-47d7-bb8c-eaad3f34e94e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:44.758612 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6f6a-0652-4c27-9811-ab3d07aa616c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:44.786090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44173d0e-14a5-4254-9cd3-b46a437fe58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:44.787115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44173d0e-14a5-4254-9cd3-b46a437fe58c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.787399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44173d0e-14a5-4254-9cd3-b46a437fe58c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.787678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44173d0e-14a5-4254-9cd3-b46a437fe58c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.791698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525e396-652b-466d-9caf-d87b631e52ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:44.792398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e396-652b-466d-9caf-d87b631e52ce None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.792682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e396-652b-466d-9caf-d87b631e52ce None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.792959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e396-652b-466d-9caf-d87b631e52ce None admin] PATH_INFO: `/v3/groups` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.793639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525e396-652b-466d-9caf-d87b631e52ce None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:44.795081 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525e396-652b-466d-9caf-d87b631e52ce None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:44.798724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44173d0e-14a5-4254-9cd3-b46a437fe58c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-44173d0e-14a5-4254-9cd3-b46a437fe58c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:44.806461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:44.807335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:44.808143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 143/304] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:44.808800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44173d0e-14a5-4254-9cd3-b46a437fe58c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:44.819596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 162/305] 10.222.0.58 () {60 vars in 1134 bytes} [Tue May 17 11:52:44 2022] POST /identity/v3/groups => generated 229 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:44.819596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525e396-652b-466d-9caf-d87b631e52ce None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:44.928667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44173d0e-14a5-4254-9cd3-b46a437fe58c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:44.928903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525e396-652b-466d-9caf-d87b631e52ce None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:44.972834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80952ff-edb4-46f0-99ef-88ece2528511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:44.974455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80952ff-edb4-46f0-99ef-88ece2528511 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.975096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80952ff-edb4-46f0-99ef-88ece2528511 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.976585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80952ff-edb4-46f0-99ef-88ece2528511 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.977382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80952ff-edb4-46f0-99ef-88ece2528511 None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:44.977700 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80952ff-edb4-46f0-99ef-88ece2528511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:44.979128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80952ff-edb4-46f0-99ef-88ece2528511 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:44.980090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209787-9bd1-4459-a2aa-7255e905de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:44.981926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209787-9bd1-4459-a2aa-7255e905de65 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:44.982441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209787-9bd1-4459-a2aa-7255e905de65 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:44.982907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209787-9bd1-4459-a2aa-7255e905de65 None admin] PATH_INFO: `/v3/users/959507b580234406a8295ca90c040e06` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:44.990794 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 163/306] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:44.996333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80952ff-edb4-46f0-99ef-88ece2528511 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:45.005020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209787-9bd1-4459-a2aa-7255e905de65 None admin] RBAC: Authorizing `identity:get_user(user_id=959507b580234406a8295ca90c040e06)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:45.006877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209787-9bd1-4459-a2aa-7255e905de65 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:45.009930 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 144/307] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:44 2022] GET /identity/v3/users/959507b580234406a8295ca90c040e06 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:45.018142 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209787-9bd1-4459-a2aa-7255e905de65 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:45.127700 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80952ff-edb4-46f0-99ef-88ece2528511 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:45.148103 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209787-9bd1-4459-a2aa-7255e905de65 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:45.165016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b265c4a-68af-412c-964e-2d9cfbe9ea70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:45.165939 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b265c4a-68af-412c-964e-2d9cfbe9ea70 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:45.166224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b265c4a-68af-412c-964e-2d9cfbe9ea70 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:45.166496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b265c4a-68af-412c-964e-2d9cfbe9ea70 None admin] PATH_INFO: `/v3/users/0f417d2f8492444cbb2ed8271bfb8ce4` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:45.167696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b265c4a-68af-412c-964e-2d9cfbe9ea70 None admin] RBAC: Authorizing `identity:get_user(user_id=0f417d2f8492444cbb2ed8271bfb8ce4)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:45.169186 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b265c4a-68af-412c-964e-2d9cfbe9ea70 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:45.175386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 164/308] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:44 2022] GET /identity/v3/users/0f417d2f8492444cbb2ed8271bfb8ce4 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:45.177221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b265c4a-68af-412c-964e-2d9cfbe9ea70 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:45.193462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54339815-415a-4e3f-84a1-66e190ef2e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:45.194303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339815-415a-4e3f-84a1-66e190ef2e58 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:45.194685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339815-415a-4e3f-84a1-66e190ef2e58 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:45.195054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339815-415a-4e3f-84a1-66e190ef2e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:45.196005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54339815-415a-4e3f-84a1-66e190ef2e58 None admin] RBAC: Adding query filter params (role.id=771bd64f51c4466a934ee622fea6214f, user.id=959507b580234406a8295ca90c040e06, scope.system=all) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:45.196440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54339815-415a-4e3f-84a1-66e190ef2e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:45.197969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54339815-415a-4e3f-84a1-66e190ef2e58 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:45.204362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 145/309] 10.222.0.58 () {56 vars in 1308 bytes} [Tue May 17 11:52:45 2022] GET /identity/v3/role_assignments?user.id=959507b580234406a8295ca90c040e06&scope.system=all&role.id=771bd64f51c4466a934ee622fea6214f => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:45.213982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13267ab-fb3e-4c68-a8e3-98a7531392bb None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:45.214418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13267ab-fb3e-4c68-a8e3-98a7531392bb None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:45.214797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13267ab-fb3e-4c68-a8e3-98a7531392bb None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:45.217372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 146/310] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:45.225782 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511dc4-230c-40a3-9687-d34b973f7e6b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:45.226146 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511dc4-230c-40a3-9687-d34b973f7e6b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:45.226330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511dc4-230c-40a3-9687-d34b973f7e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:45.244398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-29511dc4-230c-40a3-9687-d34b973f7e6b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:45.245649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-29511dc4-230c-40a3-9687-d34b973f7e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:45.299620 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b265c4a-68af-412c-964e-2d9cfbe9ea70 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:45.323667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 147/311] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:45.341851 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95fb18-8597-44fc-b5cc-7a8019877d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:45.343777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95fb18-8597-44fc-b5cc-7a8019877d3e None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:45.344486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95fb18-8597-44fc-b5cc-7a8019877d3e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:45.345011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95fb18-8597-44fc-b5cc-7a8019877d3e None admin] PATH_INFO: `/v3/system/users/0f417d2f8492444cbb2ed8271bfb8ce4/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:45.347122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29511dc4-230c-40a3-9687-d34b973f7e6b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:45.348543 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95fb18-8597-44fc-b5cc-7a8019877d3e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0f417d2f8492444cbb2ed8271bfb8ce4, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:45.350392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95fb18-8597-44fc-b5cc-7a8019877d3e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:45.362780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 165/312] 10.222.0.58 () {58 vars in 1334 bytes} [Tue May 17 11:52:45 2022] PUT /identity/v3/system/users/0f417d2f8492444cbb2ed8271bfb8ce4/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 11:52:45.490276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29511dc4-230c-40a3-9687-d34b973f7e6b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:45.538049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddae3a-0449-4ef0-88ba-53e3d3e8f417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:45.538880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddae3a-0449-4ef0-88ba-53e3d3e8f417 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:45.539162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddae3a-0449-4ef0-88ba-53e3d3e8f417 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:45.539441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddae3a-0449-4ef0-88ba-53e3d3e8f417 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:45.551419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddae3a-0449-4ef0-88ba-53e3d3e8f417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-fcddae3a-0449-4ef0-88ba-53e3d3e8f417 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:45.559619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:45.560801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:45.562024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 148/313] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:45.567284 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95fb18-8597-44fc-b5cc-7a8019877d3e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:45.680293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95fb18-8597-44fc-b5cc-7a8019877d3e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:45.716303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb652-1dd9-4c04-9896-061c7407ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:45.717369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb652-1dd9-4c04-9896-061c7407ea9a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:45.717925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb652-1dd9-4c04-9896-061c7407ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:45.718472 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb652-1dd9-4c04-9896-061c7407ea9a None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:45.719610 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeb652-1dd9-4c04-9896-061c7407ea9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:45.720122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeb652-1dd9-4c04-9896-061c7407ea9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:45.721791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeeb652-1dd9-4c04-9896-061c7407ea9a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:45.730911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 166/314] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:45.736655 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddae3a-0449-4ef0-88ba-53e3d3e8f417 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:45.838347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddae3a-0449-4ef0-88ba-53e3d3e8f417 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:45.871578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d86d73-e8b2-43db-a406-ea4c4dfcf5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:45.872481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d86d73-e8b2-43db-a406-ea4c4dfcf5dc None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:45.872766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d86d73-e8b2-43db-a406-ea4c4dfcf5dc None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:45.873042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d86d73-e8b2-43db-a406-ea4c4dfcf5dc None admin] PATH_INFO: `/v3/users/764f303d8dfb4448950993905627f5b3` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:45.874236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d86d73-e8b2-43db-a406-ea4c4dfcf5dc None admin] RBAC: Authorizing `identity:get_user(user_id=764f303d8dfb4448950993905627f5b3)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:45.875741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d86d73-e8b2-43db-a406-ea4c4dfcf5dc None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:45.877694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 149/315] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:45 2022] GET /identity/v3/users/764f303d8dfb4448950993905627f5b3 => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:45.882820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb652-1dd9-4c04-9896-061c7407ea9a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:45.987851 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb652-1dd9-4c04-9896-061c7407ea9a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:46.022354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c7897-7176-4d5a-863b-22944b8fd9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:46.023390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c7897-7176-4d5a-863b-22944b8fd9fe None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:46.023864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c7897-7176-4d5a-863b-22944b8fd9fe None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:46.024381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c7897-7176-4d5a-863b-22944b8fd9fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:46.094379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c7897-7176-4d5a-863b-22944b8fd9fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:46.096159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c7897-7176-4d5a-863b-22944b8fd9fe None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:46.197285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 167/316] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:46.203096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d86d73-e8b2-43db-a406-ea4c4dfcf5dc None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:46.305822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d86d73-e8b2-43db-a406-ea4c4dfcf5dc None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:46.339717 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f00089-63b1-4e9d-b996-09933bdee2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:46.340606 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00089-63b1-4e9d-b996-09933bdee2c5 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:46.340887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00089-63b1-4e9d-b996-09933bdee2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:46.341164 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00089-63b1-4e9d-b996-09933bdee2c5 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:46.342354 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f00089-63b1-4e9d-b996-09933bdee2c5 None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:46.343828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f00089-63b1-4e9d-b996-09933bdee2c5 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:46.345941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 150/317] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:46 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:46.351648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c7897-7176-4d5a-863b-22944b8fd9fe None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:46.455320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c7897-7176-4d5a-863b-22944b8fd9fe None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:46.490718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b5865-207d-4ecf-8d47-ef1b73a6460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:46.491721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b5865-207d-4ecf-8d47-ef1b73a6460d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:46.492221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b5865-207d-4ecf-8d47-ef1b73a6460d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:46.492686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b5865-207d-4ecf-8d47-ef1b73a6460d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:46.493703 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b5865-207d-4ecf-8d47-ef1b73a6460d None admin] RBAC: Adding query filter params (role.id=771bd64f51c4466a934ee622fea6214f, scope.project.id=83915a029ef141e7a371da8296ea927d, user.id=764f303d8dfb4448950993905627f5b3) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:46.494224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b5865-207d-4ecf-8d47-ef1b73a6460d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:46.495860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b5865-207d-4ecf-8d47-ef1b73a6460d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:46.504062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 168/318] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:52:46 2022] GET /identity/v3/role_assignments?user.id=764f303d8dfb4448950993905627f5b3&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=771bd64f51c4466a934ee622fea6214f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:47.178304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083a40-164f-4524-9ba0-cbccadb27b63 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:47.178698 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083a40-164f-4524-9ba0-cbccadb27b63 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:47.178868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083a40-164f-4524-9ba0-cbccadb27b63 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:47.180391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 151/319] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:47.185605 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a5ea-d391-44d9-811f-db81375441aa None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:47.185898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a5ea-d391-44d9-811f-db81375441aa None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:47.186174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a5ea-d391-44d9-811f-db81375441aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:47.202572 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-adf9a5ea-d391-44d9-811f-db81375441aa None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:47.204291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-adf9a5ea-d391-44d9-811f-db81375441aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:47.268648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 169/320] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:47.290150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c083a40-164f-4524-9ba0-cbccadb27b63 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:47.394034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c083a40-164f-4524-9ba0-cbccadb27b63 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:47.426803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b55a0-bdae-4482-8a23-799211766813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:47.427598 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b55a0-bdae-4482-8a23-799211766813 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:47.427878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b55a0-bdae-4482-8a23-799211766813 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:47.428157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b55a0-bdae-4482-8a23-799211766813 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:47.429381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b55a0-bdae-4482-8a23-799211766813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:47.430754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b55a0-bdae-4482-8a23-799211766813 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:47.432602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 152/321] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:52:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:47.438462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9a5ea-d391-44d9-811f-db81375441aa None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:47.532250 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fdcd8-7f4c-4447-93cc-2ec57d8894b1 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:47.532904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fdcd8-7f4c-4447-93cc-2ec57d8894b1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:47.533370 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fdcd8-7f4c-4447-93cc-2ec57d8894b1 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:47.535006 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 153/322] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:47.541817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3cd55-2d02-46ff-80a5-494038d17fff None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:47.542189 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3cd55-2d02-46ff-80a5-494038d17fff None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:47.542538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3cd55-2d02-46ff-80a5-494038d17fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:47.543237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9a5ea-d391-44d9-811f-db81375441aa None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:47.558983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-0af3cd55-2d02-46ff-80a5-494038d17fff None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:47.560444 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0af3cd55-2d02-46ff-80a5-494038d17fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:47.578908 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84405393-f271-4f48-8575-1eb62b9e729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:47.579581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84405393-f271-4f48-8575-1eb62b9e729c None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:47.579863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84405393-f271-4f48-8575-1eb62b9e729c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:47.580135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84405393-f271-4f48-8575-1eb62b9e729c None admin] PATH_INFO: `/v3/groups` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:47.580861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84405393-f271-4f48-8575-1eb62b9e729c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:47.582315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84405393-f271-4f48-8575-1eb62b9e729c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:47.597499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 170/323] 10.222.0.58 () {60 vars in 1134 bytes} [Tue May 17 11:52:47 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:52:47.634718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 154/324] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:47.658305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84405393-f271-4f48-8575-1eb62b9e729c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:47.711555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d972b59-0aba-42c9-bf56-06d9637194f2 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:47.711848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d972b59-0aba-42c9-bf56-06d9637194f2 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:47.712046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d972b59-0aba-42c9-bf56-06d9637194f2 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:47.713626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 155/325] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:47.719261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d2b2-9a77-4d0d-ace2-b098ca23de27 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:47.719654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d2b2-9a77-4d0d-ace2-b098ca23de27 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:47.719942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555d2b2-9a77-4d0d-ace2-b098ca23de27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:47.737415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4555d2b2-9a77-4d0d-ace2-b098ca23de27 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:47.738619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4555d2b2-9a77-4d0d-ace2-b098ca23de27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:47.762843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84405393-f271-4f48-8575-1eb62b9e729c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:47.799709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a4659-737b-4400-a1d5-d16e44bf6cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:47.800549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a4659-737b-4400-a1d5-d16e44bf6cbc None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:47.800832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a4659-737b-4400-a1d5-d16e44bf6cbc None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:47.801107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a4659-737b-4400-a1d5-d16e44bf6cbc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:47.811617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 156/326] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:47.813653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a4659-737b-4400-a1d5-d16e44bf6cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-d37a4659-737b-4400-a1d5-d16e44bf6cbc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:47.821477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:47.822324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:47.823088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:47.823671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 171/327] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:47.830067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d2b2-9a77-4d0d-ace2-b098ca23de27 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:47.835875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a4659-737b-4400-a1d5-d16e44bf6cbc None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:47.957943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555d2b2-9a77-4d0d-ace2-b098ca23de27 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:47.963116 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a4659-737b-4400-a1d5-d16e44bf6cbc None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:48.001693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2821c-74bd-4111-aa62-c8e66c79208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:48.002744 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2821c-74bd-4111-aa62-c8e66c79208a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:48.003173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2821c-74bd-4111-aa62-c8e66c79208a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:48.003688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2821c-74bd-4111-aa62-c8e66c79208a None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:48.004239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8b953-bfa9-4cb4-8435-d1f76d560753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:48.004833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2821c-74bd-4111-aa62-c8e66c79208a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:48.005218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b953-bfa9-4cb4-8435-d1f76d560753 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:48.005429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2821c-74bd-4111-aa62-c8e66c79208a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:48.005678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b953-bfa9-4cb4-8435-d1f76d560753 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:48.006047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8b953-bfa9-4cb4-8435-d1f76d560753 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:48.007457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2821c-74bd-4111-aa62-c8e66c79208a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:48.017620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 157/328] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:48.019980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8b953-bfa9-4cb4-8435-d1f76d560753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:48.023145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2821c-74bd-4111-aa62-c8e66c79208a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-44d8b953-bfa9-4cb4-8435-d1f76d560753 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:48.026786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:48.027645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:48.028510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 172/329] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:52:48.033954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8b953-bfa9-4cb4-8435-d1f76d560753 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:48.157321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2821c-74bd-4111-aa62-c8e66c79208a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:48.163125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8b953-bfa9-4cb4-8435-d1f76d560753 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:48.198143 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc18128-698d-420f-b5f7-ed3c20bb3b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:48.198814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc18128-698d-420f-b5f7-ed3c20bb3b9e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:48.199097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc18128-698d-420f-b5f7-ed3c20bb3b9e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:48.199377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc18128-698d-420f-b5f7-ed3c20bb3b9e None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:48.200140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc18128-698d-420f-b5f7-ed3c20bb3b9e None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:48.202012 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc18128-698d-420f-b5f7-ed3c20bb3b9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:48.204168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc18128-698d-420f-b5f7-ed3c20bb3b9e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:48.205651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ca35b-3756-4777-b111-1bcbfbd95ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:48.207145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ca35b-3756-4777-b111-1bcbfbd95ddf None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:48.207435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ca35b-3756-4777-b111-1bcbfbd95ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:48.207716 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ca35b-3756-4777-b111-1bcbfbd95ddf None admin] PATH_INFO: `/v3/users/959507b580234406a8295ca90c040e06` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:48.209142 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ca35b-3756-4777-b111-1bcbfbd95ddf None admin] RBAC: Authorizing `identity:get_user(user_id=959507b580234406a8295ca90c040e06)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:48.211078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ca35b-3756-4777-b111-1bcbfbd95ddf None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:48.213447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 158/330] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:48 2022] GET /identity/v3/users/959507b580234406a8295ca90c040e06 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:48.214210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 173/331] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:48.219031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ca35b-3756-4777-b111-1bcbfbd95ddf None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:48.219888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc18128-698d-420f-b5f7-ed3c20bb3b9e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:48.331487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ca35b-3756-4777-b111-1bcbfbd95ddf None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:48.338343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc18128-698d-420f-b5f7-ed3c20bb3b9e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:48.364965 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864b292-4965-4422-8afa-a6790f32f096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:48.365835 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b292-4965-4422-8afa-a6790f32f096 None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:48.366124 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b292-4965-4422-8afa-a6790f32f096 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:48.366404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b292-4965-4422-8afa-a6790f32f096 None admin] PATH_INFO: `/v3/system/users/959507b580234406a8295ca90c040e06/roles/771bd64f51c4466a934ee622fea6214f` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:48.367930 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864b292-4965-4422-8afa-a6790f32f096 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=959507b580234406a8295ca90c040e06, role_id=771bd64f51c4466a934ee622fea6214f)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:48.369356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864b292-4965-4422-8afa-a6790f32f096 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:48.372551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad3cdc-62ea-48ee-8a13-cb24230078e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:48.373423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad3cdc-62ea-48ee-8a13-cb24230078e9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:48.373708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad3cdc-62ea-48ee-8a13-cb24230078e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:48.373985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad3cdc-62ea-48ee-8a13-cb24230078e9 None admin] PATH_INFO: `/v3/users/0f417d2f8492444cbb2ed8271bfb8ce4` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:48.376024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad3cdc-62ea-48ee-8a13-cb24230078e9 None admin] RBAC: Authorizing `identity:get_user(user_id=0f417d2f8492444cbb2ed8271bfb8ce4)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:48.377553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad3cdc-62ea-48ee-8a13-cb24230078e9 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:48.379698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 174/332] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:48 2022] GET /identity/v3/users/0f417d2f8492444cbb2ed8271bfb8ce4 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:48.380035 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 159/333] 10.222.0.58 () {58 vars in 1334 bytes} [Tue May 17 11:52:48 2022] PUT /identity/v3/system/users/959507b580234406a8295ca90c040e06/roles/771bd64f51c4466a934ee622fea6214f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 11:52:48.385566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad3cdc-62ea-48ee-8a13-cb24230078e9 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:48.509987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad3cdc-62ea-48ee-8a13-cb24230078e9 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:48.547221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4b15d-cc56-413a-ba8f-7680437044b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:48.547891 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4b15d-cc56-413a-ba8f-7680437044b8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:48.548174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4b15d-cc56-413a-ba8f-7680437044b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:48.548479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4b15d-cc56-413a-ba8f-7680437044b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:48.549326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4b15d-cc56-413a-ba8f-7680437044b8 None admin] RBAC: Adding query filter params (role.id=1ead91d8230c468cabd0637c833c42ac, user.id=0f417d2f8492444cbb2ed8271bfb8ce4, scope.system=all) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:48.549637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4b15d-cc56-413a-ba8f-7680437044b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:48.551109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4b15d-cc56-413a-ba8f-7680437044b8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:48.565835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 175/334] 10.222.0.58 () {56 vars in 1308 bytes} [Tue May 17 11:52:48 2022] GET /identity/v3/role_assignments?user.id=0f417d2f8492444cbb2ed8271bfb8ce4&scope.system=all&role.id=1ead91d8230c468cabd0637c833c42ac => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:50.166167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac678b1-9c62-4e36-b3cb-5951e0917578 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:50.167035 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac678b1-9c62-4e36-b3cb-5951e0917578 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:50.167542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac678b1-9c62-4e36-b3cb-5951e0917578 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:50.169469 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 160/335] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:50.175476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599c358-75d4-4403-940c-8260d261f42e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:50.176428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599c358-75d4-4403-940c-8260d261f42e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:50.176917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599c358-75d4-4403-940c-8260d261f42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:50.197877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7599c358-75d4-4403-940c-8260d261f42e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:50.199452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7599c358-75d4-4403-940c-8260d261f42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:50.280482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 176/336] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:50.326456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac678b1-9c62-4e36-b3cb-5951e0917578 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:50.461352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac678b1-9c62-4e36-b3cb-5951e0917578 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:50.503806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea2166-950a-4ef2-947d-06c8c40566dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:50.505015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea2166-950a-4ef2-947d-06c8c40566dd None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:50.505499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea2166-950a-4ef2-947d-06c8c40566dd None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:50.505973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea2166-950a-4ef2-947d-06c8c40566dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:50.520141 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea2166-950a-4ef2-947d-06c8c40566dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-cbea2166-950a-4ef2-947d-06c8c40566dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:50.528385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:50.529262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:50.530518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:50.538331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 161/337] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:50.543692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599c358-75d4-4403-940c-8260d261f42e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:50.652321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599c358-75d4-4403-940c-8260d261f42e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:50.691681 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da92018-c65d-4e81-8ee4-13885b16f0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:50.692448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92018-c65d-4e81-8ee4-13885b16f0f8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:50.692731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92018-c65d-4e81-8ee4-13885b16f0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:50.693007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92018-c65d-4e81-8ee4-13885b16f0f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:50.693763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92018-c65d-4e81-8ee4-13885b16f0f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:50.694066 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92018-c65d-4e81-8ee4-13885b16f0f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:50.695443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92018-c65d-4e81-8ee4-13885b16f0f8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:50.707956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 177/338] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:50.713591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea2166-950a-4ef2-947d-06c8c40566dd None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:50.714733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8ac69-bb4d-4415-b331-44fe59c56698 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:50.715052 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8ac69-bb4d-4415-b331-44fe59c56698 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:50.715298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8ac69-bb4d-4415-b331-44fe59c56698 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:50.716885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 178/339] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:50.728204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab60a-cfc8-4501-b93f-be63f5657d49 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:50.728204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab60a-cfc8-4501-b93f-be63f5657d49 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:50.728204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab60a-cfc8-4501-b93f-be63f5657d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:50.748929 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-8ffab60a-cfc8-4501-b93f-be63f5657d49 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:50.750136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-8ffab60a-cfc8-4501-b93f-be63f5657d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:50.871229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea2166-950a-4ef2-947d-06c8c40566dd None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:50.900217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 179/340] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:50.912159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ca767-dba6-47fc-9813-b6ff41e1bec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:50.913227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca767-dba6-47fc-9813-b6ff41e1bec4 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:50.913713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca767-dba6-47fc-9813-b6ff41e1bec4 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:50.914225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ca767-dba6-47fc-9813-b6ff41e1bec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:50.940760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab60a-cfc8-4501-b93f-be63f5657d49 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:50.994393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ca767-dba6-47fc-9813-b6ff41e1bec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:50.996381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ca767-dba6-47fc-9813-b6ff41e1bec4 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:51.118725 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 162/341] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:51.129297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ca767-dba6-47fc-9813-b6ff41e1bec4 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:51.186647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab60a-cfc8-4501-b93f-be63f5657d49 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:51.223858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0ff2a-4173-425e-aebf-9faf28152e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:51.225044 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0ff2a-4173-425e-aebf-9faf28152e29 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:51.225524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0ff2a-4173-425e-aebf-9faf28152e29 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:51.225988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0ff2a-4173-425e-aebf-9faf28152e29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:51.241484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0ff2a-4173-425e-aebf-9faf28152e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:51.248067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ca767-dba6-47fc-9813-b6ff41e1bec4 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-a3e0ff2a-4173-425e-aebf-9faf28152e29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:51.254366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:51.255434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:51.256342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:51.257508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 180/342] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:52:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:51.262734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0ff2a-4173-425e-aebf-9faf28152e29 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:51.300504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207126a-310b-4ef0-ace6-668b949cc62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:51.301748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207126a-310b-4ef0-ace6-668b949cc62a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:51.302212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207126a-310b-4ef0-ace6-668b949cc62a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:51.302664 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207126a-310b-4ef0-ace6-668b949cc62a None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:51.304212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207126a-310b-4ef0-ace6-668b949cc62a None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:51.306536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207126a-310b-4ef0-ace6-668b949cc62a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:51.308686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 163/343] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:51 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:51.316294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207126a-310b-4ef0-ace6-668b949cc62a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:51.485694 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0ff2a-4173-425e-aebf-9faf28152e29 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:51.493559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207126a-310b-4ef0-ace6-668b949cc62a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:51.541910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f5986-f7fc-4e18-a6ec-558d7cb43540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:51.542797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f5986-f7fc-4e18-a6ec-558d7cb43540 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:51.543081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f5986-f7fc-4e18-a6ec-558d7cb43540 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:51.543359 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f5986-f7fc-4e18-a6ec-558d7cb43540 None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:51.554713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f5986-f7fc-4e18-a6ec-558d7cb43540 None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:51.556173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f5986-f7fc-4e18-a6ec-558d7cb43540 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:51.558660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 164/344] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:52:51 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:51.560172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14be6-eacb-4b53-ad17-7de905535994 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:51.560489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14be6-eacb-4b53-ad17-7de905535994 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:51.560767 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b14be6-eacb-4b53-ad17-7de905535994 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:51.562008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 165/345] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:51.567473 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b14be6-eacb-4b53-ad17-7de905535994 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:51.568462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713ff2a-aeff-4136-bb3b-a6c5ad82ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:51.569142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ff2a-aeff-4136-bb3b-a6c5ad82ad14 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:51.569429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ff2a-aeff-4136-bb3b-a6c5ad82ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:51.569708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ff2a-aeff-4136-bb3b-a6c5ad82ad14 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:51.570469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713ff2a-aeff-4136-bb3b-a6c5ad82ad14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:51.570781 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713ff2a-aeff-4136-bb3b-a6c5ad82ad14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:51.572169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713ff2a-aeff-4136-bb3b-a6c5ad82ad14 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:51.595144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 181/346] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:52:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:51.596124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9a577-4281-4f93-b52f-25ac1a46d2bf None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:51.596450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9a577-4281-4f93-b52f-25ac1a46d2bf None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:51.596726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9a577-4281-4f93-b52f-25ac1a46d2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:51.614656 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-d5d9a577-4281-4f93-b52f-25ac1a46d2bf None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:51.615933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-d5d9a577-4281-4f93-b52f-25ac1a46d2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:51.686625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 182/347] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:51.687831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9a577-4281-4f93-b52f-25ac1a46d2bf None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:51.745025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b14be6-eacb-4b53-ad17-7de905535994 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:51.792221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9a577-4281-4f93-b52f-25ac1a46d2bf None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:51.827109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abd180-da67-4728-838e-32e2a2677976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:51.827778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abd180-da67-4728-838e-32e2a2677976 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:51.828663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abd180-da67-4728-838e-32e2a2677976 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:51.829109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abd180-da67-4728-838e-32e2a2677976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:51.834000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c72c9c-2408-43db-b237-78b52d65d5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:51.834670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c72c9c-2408-43db-b237-78b52d65d5af None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:51.834963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c72c9c-2408-43db-b237-78b52d65d5af None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:51.835248 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c72c9c-2408-43db-b237-78b52d65d5af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:51.836100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c72c9c-2408-43db-b237-78b52d65d5af None admin] RBAC: Adding query filter params (group.id=879f7fdad40d4670a00f43b0bc463c73, role.id=1ead91d8230c468cabd0637c833c42ac, scope.project.id=1da154bbce234bbe9e9dfabe1b861662) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:51.836448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c72c9c-2408-43db-b237-78b52d65d5af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:51.837903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c72c9c-2408-43db-b237-78b52d65d5af None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:51.854301 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 166/348] 10.222.0.58 () {56 vars in 1376 bytes} [Tue May 17 11:52:51 2022] GET /identity/v3/role_assignments?group.id=879f7fdad40d4670a00f43b0bc463c73&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=1ead91d8230c468cabd0637c833c42ac => generated 260 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:51.855164 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c72c9c-2408-43db-b237-78b52d65d5af None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:51.911695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abd180-da67-4728-838e-32e2a2677976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:51.917442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abd180-da67-4728-838e-32e2a2677976 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:52.067877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 183/349] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:52.069213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f1397-5b34-46ef-833d-05096725c7bf None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.069473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f1397-5b34-46ef-833d-05096725c7bf None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.069746 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f1397-5b34-46ef-833d-05096725c7bf None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.071070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 184/350] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:52.077752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fd500-c1b4-472a-8275-2d281529d1f1 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.078134 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fd500-c1b4-472a-8275-2d281529d1f1 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.078535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fd500-c1b4-472a-8275-2d281529d1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.096141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-615fd500-c1b4-472a-8275-2d281529d1f1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:52.097348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-615fd500-c1b4-472a-8275-2d281529d1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:52.100308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c72c9c-2408-43db-b237-78b52d65d5af None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:52.172275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 185/351] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:52.173367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fd500-c1b4-472a-8275-2d281529d1f1 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:52.193029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed314a-fa09-40f7-a7c2-71cd43cdea7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:52.193867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed314a-fa09-40f7-a7c2-71cd43cdea7e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.194153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed314a-fa09-40f7-a7c2-71cd43cdea7e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.194435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed314a-fa09-40f7-a7c2-71cd43cdea7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.221139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed314a-fa09-40f7-a7c2-71cd43cdea7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-e1ed314a-fa09-40f7-a7c2-71cd43cdea7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:52.229360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:52.231517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:52.233543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 167/352] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:52.241685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed314a-fa09-40f7-a7c2-71cd43cdea7e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:52.307896 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fd500-c1b4-472a-8275-2d281529d1f1 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:52.365710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed314a-fa09-40f7-a7c2-71cd43cdea7e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:52.385477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc8ba7-e2fd-4320-b763-aca177ff5df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:52.386354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc8ba7-e2fd-4320-b763-aca177ff5df6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.386633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc8ba7-e2fd-4320-b763-aca177ff5df6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.386902 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc8ba7-e2fd-4320-b763-aca177ff5df6 None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.388112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc8ba7-e2fd-4320-b763-aca177ff5df6 None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:52.389548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc8ba7-e2fd-4320-b763-aca177ff5df6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:52.392004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 186/353] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:52 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:52.392614 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc8ba7-e2fd-4320-b763-aca177ff5df6 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:52.402500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46af46c-6c15-45c6-b9bd-cca25121769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:52.403244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46af46c-6c15-45c6-b9bd-cca25121769c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.403536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46af46c-6c15-45c6-b9bd-cca25121769c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.403815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46af46c-6c15-45c6-b9bd-cca25121769c None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.404731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46af46c-6c15-45c6-b9bd-cca25121769c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:52.405046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46af46c-6c15-45c6-b9bd-cca25121769c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:52.407554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46af46c-6c15-45c6-b9bd-cca25121769c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:52.416795 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 168/354] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:52.417725 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46af46c-6c15-45c6-b9bd-cca25121769c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:52.528937 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46af46c-6c15-45c6-b9bd-cca25121769c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:52.556138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc8ba7-e2fd-4320-b763-aca177ff5df6 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:52.568958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad39c-96b0-4768-9781-5f4bf7d1c14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:52.569913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad39c-96b0-4768-9781-5f4bf7d1c14d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.570201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad39c-96b0-4768-9781-5f4bf7d1c14d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.570535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ad39c-96b0-4768-9781-5f4bf7d1c14d None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.571993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ad39c-96b0-4768-9781-5f4bf7d1c14d None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:52.574169 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ad39c-96b0-4768-9781-5f4bf7d1c14d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:52.575925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 169/355] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:52:52 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:52.576928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad39c-96b0-4768-9781-5f4bf7d1c14d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:52.614438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d177ec0-25e9-495b-93ac-f268caec4cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:52.615242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d177ec0-25e9-495b-93ac-f268caec4cfb None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.615520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d177ec0-25e9-495b-93ac-f268caec4cfb None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.615846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d177ec0-25e9-495b-93ac-f268caec4cfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.633278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d177ec0-25e9-495b-93ac-f268caec4cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-6d177ec0-25e9-495b-93ac-f268caec4cfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:52.641599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:52.642657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:52.643624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:52.646884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 187/356] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:52.647826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d177ec0-25e9-495b-93ac-f268caec4cfb None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:52.688656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ad39c-96b0-4768-9781-5f4bf7d1c14d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:52.725258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897cbd7-088a-4776-a795-acf7eae460fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:52.726141 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897cbd7-088a-4776-a795-acf7eae460fe None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.726427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897cbd7-088a-4776-a795-acf7eae460fe None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.726708 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897cbd7-088a-4776-a795-acf7eae460fe None admin] PATH_INFO: `/v3/users/959507b580234406a8295ca90c040e06` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.728103 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897cbd7-088a-4776-a795-acf7eae460fe None admin] RBAC: Authorizing `identity:get_user(user_id=959507b580234406a8295ca90c040e06)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:52.729595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897cbd7-088a-4776-a795-acf7eae460fe None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:52.731639 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 170/357] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:52:52 2022] GET /identity/v3/users/959507b580234406a8295ca90c040e06 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:52.732514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897cbd7-088a-4776-a795-acf7eae460fe None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:52.757380 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d177ec0-25e9-495b-93ac-f268caec4cfb None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:52.797244 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24061ee8-499b-4518-97d8-bc33b657c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:52.798203 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24061ee8-499b-4518-97d8-bc33b657c33f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.798644 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24061ee8-499b-4518-97d8-bc33b657c33f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.799060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24061ee8-499b-4518-97d8-bc33b657c33f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.800042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24061ee8-499b-4518-97d8-bc33b657c33f None admin] RBAC: Adding query filter params (group.id=879f7fdad40d4670a00f43b0bc463c73, role.id=297b3b3e5982438e9af6c05761718fcc, scope.project.id=1da154bbce234bbe9e9dfabe1b861662) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:52.800516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24061ee8-499b-4518-97d8-bc33b657c33f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:52.802121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24061ee8-499b-4518-97d8-bc33b657c33f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:52.808954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 188/358] 10.222.0.58 () {56 vars in 1376 bytes} [Tue May 17 11:52:52 2022] GET /identity/v3/role_assignments?group.id=879f7fdad40d4670a00f43b0bc463c73&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=297b3b3e5982438e9af6c05761718fcc => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:52.810356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24061ee8-499b-4518-97d8-bc33b657c33f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:52.863776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897cbd7-088a-4776-a795-acf7eae460fe None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:52.902077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e76ad0-28b3-4547-a43b-052d88d1c9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:52.903109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e76ad0-28b3-4547-a43b-052d88d1c9b4 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.903590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e76ad0-28b3-4547-a43b-052d88d1c9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.904058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e76ad0-28b3-4547-a43b-052d88d1c9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.905025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e76ad0-28b3-4547-a43b-052d88d1c9b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:52.905530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e76ad0-28b3-4547-a43b-052d88d1c9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:52.908466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e76ad0-28b3-4547-a43b-052d88d1c9b4 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:52.917605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 171/359] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:52.920005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24061ee8-499b-4518-97d8-bc33b657c33f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:52.925036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e76ad0-28b3-4547-a43b-052d88d1c9b4 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:52.972955 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f938bc4-1ba3-4616-afb0-31db70049488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:52.973629 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938bc4-1ba3-4616-afb0-31db70049488 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.973913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938bc4-1ba3-4616-afb0-31db70049488 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.974187 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938bc4-1ba3-4616-afb0-31db70049488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.975035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f938bc4-1ba3-4616-afb0-31db70049488 None admin] RBAC: Adding query filter params (role.id=771bd64f51c4466a934ee622fea6214f, user.id=959507b580234406a8295ca90c040e06, scope.system=all) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:52.975331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f938bc4-1ba3-4616-afb0-31db70049488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:52.976904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f938bc4-1ba3-4616-afb0-31db70049488 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:52.990077 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 189/360] 10.222.0.58 () {56 vars in 1308 bytes} [Tue May 17 11:52:52 2022] GET /identity/v3/role_assignments?user.id=959507b580234406a8295ca90c040e06&scope.system=all&role.id=771bd64f51c4466a934ee622fea6214f => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:52.991421 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e9476-a521-4a92-9f2f-bed39fe702ba None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:52.991679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e9476-a521-4a92-9f2f-bed39fe702ba None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:52.991956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e9476-a521-4a92-9f2f-bed39fe702ba None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:52.994974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 190/361] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:53.002176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd44ca1-8ca5-4140-9152-d2fbd614fa62 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.002477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd44ca1-8ca5-4140-9152-d2fbd614fa62 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.002734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd44ca1-8ca5-4140-9152-d2fbd614fa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.037391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-dcd44ca1-8ca5-4140-9152-d2fbd614fa62 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:53.038731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-dcd44ca1-8ca5-4140-9152-d2fbd614fa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:53.047997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e76ad0-28b3-4547-a43b-052d88d1c9b4 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:53.087914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8b45c-bf59-4dc3-95b4-dd842ac10512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:53.088969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8b45c-bf59-4dc3-95b4-dd842ac10512 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.089491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8b45c-bf59-4dc3-95b4-dd842ac10512 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.089984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8b45c-bf59-4dc3-95b4-dd842ac10512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.151064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 191/362] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:53.152574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f9342-9909-4954-bd7c-63b725cae342 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.152765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f9342-9909-4954-bd7c-63b725cae342 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.153041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f9342-9909-4954-bd7c-63b725cae342 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.154653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 192/363] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:53.160496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d481aa-9271-4dcb-b9d1-e2a45ffdf425 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.160778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d481aa-9271-4dcb-b9d1-e2a45ffdf425 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.161058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d481aa-9271-4dcb-b9d1-e2a45ffdf425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.178841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8b45c-bf59-4dc3-95b4-dd842ac10512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:53.179334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a2d481aa-9271-4dcb-b9d1-e2a45ffdf425 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:53.180910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8b45c-bf59-4dc3-95b4-dd842ac10512 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:53.181594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a2d481aa-9271-4dcb-b9d1-e2a45ffdf425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:53.255192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 193/364] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:53.256084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d481aa-9271-4dcb-b9d1-e2a45ffdf425 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:53.296695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 172/365] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:53.302073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8b45c-bf59-4dc3-95b4-dd842ac10512 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:53.367274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d481aa-9271-4dcb-b9d1-e2a45ffdf425 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:53.402494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d394d-0274-41c7-835a-1e2502f742ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:53.403371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d394d-0274-41c7-835a-1e2502f742ce None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.403581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d394d-0274-41c7-835a-1e2502f742ce None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.403856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d394d-0274-41c7-835a-1e2502f742ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.415389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d394d-0274-41c7-835a-1e2502f742ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-102d394d-0274-41c7-835a-1e2502f742ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:53.425967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:53.429055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 194/366] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:53.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d394d-0274-41c7-835a-1e2502f742ce None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:53.436572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8b45c-bf59-4dc3-95b4-dd842ac10512 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:53.474536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ac1ed-6ccd-4f26-91cb-42c69bc165fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:53.475715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac1ed-6ccd-4f26-91cb-42c69bc165fb None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.476173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac1ed-6ccd-4f26-91cb-42c69bc165fb None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.476667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac1ed-6ccd-4f26-91cb-42c69bc165fb None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.478042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ac1ed-6ccd-4f26-91cb-42c69bc165fb None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:53.479636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ac1ed-6ccd-4f26-91cb-42c69bc165fb None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:53.481954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 173/367] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:53 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:53.482956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ac1ed-6ccd-4f26-91cb-42c69bc165fb None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:53.529533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d394d-0274-41c7-835a-1e2502f742ce None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:53.564270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697d6e3-41d9-480b-9787-9be1af5a91dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:53.565132 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697d6e3-41d9-480b-9787-9be1af5a91dd None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.565355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697d6e3-41d9-480b-9787-9be1af5a91dd None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.565627 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697d6e3-41d9-480b-9787-9be1af5a91dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.576332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697d6e3-41d9-480b-9787-9be1af5a91dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-0697d6e3-41d9-480b-9787-9be1af5a91dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:53.584840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:53.585765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:53.586526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 195/368] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:52:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:53.587165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697d6e3-41d9-480b-9787-9be1af5a91dd None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:53.588047 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ac1ed-6ccd-4f26-91cb-42c69bc165fb None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:53.627626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7be18-9341-479f-9562-598d8f889a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:53.628585 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7be18-9341-479f-9562-598d8f889a04 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.629017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7be18-9341-479f-9562-598d8f889a04 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.629447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7be18-9341-479f-9562-598d8f889a04 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.630334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7be18-9341-479f-9562-598d8f889a04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:53.630955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7be18-9341-479f-9562-598d8f889a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:53.632485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7be18-9341-479f-9562-598d8f889a04 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:53.641506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 174/369] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:53.642636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7be18-9341-479f-9562-598d8f889a04 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:53.689833 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697d6e3-41d9-480b-9787-9be1af5a91dd None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:53.723648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89895f60-4634-4187-a900-10d353be7e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:53.724724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89895f60-4634-4187-a900-10d353be7e35 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.724832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89895f60-4634-4187-a900-10d353be7e35 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.725083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89895f60-4634-4187-a900-10d353be7e35 None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.726269 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89895f60-4634-4187-a900-10d353be7e35 None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:53.727721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89895f60-4634-4187-a900-10d353be7e35 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:53.729355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 196/370] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:52:53 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:53.730112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89895f60-4634-4187-a900-10d353be7e35 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:53.749304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7be18-9341-479f-9562-598d8f889a04 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:53.785310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944cc1d-04c4-40b7-99c9-48ed5ca4f721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:53.786348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944cc1d-04c4-40b7-99c9-48ed5ca4f721 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.786841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944cc1d-04c4-40b7-99c9-48ed5ca4f721 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.787318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944cc1d-04c4-40b7-99c9-48ed5ca4f721 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.788312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944cc1d-04c4-40b7-99c9-48ed5ca4f721 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:53.788826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944cc1d-04c4-40b7-99c9-48ed5ca4f721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:53.790447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944cc1d-04c4-40b7-99c9-48ed5ca4f721 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:53.799641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 175/371] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:52:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:53.800767 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944cc1d-04c4-40b7-99c9-48ed5ca4f721 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:53.834940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89895f60-4634-4187-a900-10d353be7e35 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:53.869095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd680201-f833-4d0c-887d-78987db7b272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:53.869732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd680201-f833-4d0c-887d-78987db7b272 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.870017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd680201-f833-4d0c-887d-78987db7b272 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.870290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd680201-f833-4d0c-887d-78987db7b272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.904111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944cc1d-04c4-40b7-99c9-48ed5ca4f721 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:53.939169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd680201-f833-4d0c-887d-78987db7b272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:53.939816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02462b-739e-4ccc-8838-bd1714dbbc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:53.940724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd680201-f833-4d0c-887d-78987db7b272 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:53.941077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02462b-739e-4ccc-8838-bd1714dbbc0c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:53.941558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02462b-739e-4ccc-8838-bd1714dbbc0c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:53.942032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02462b-739e-4ccc-8838-bd1714dbbc0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:53.943108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02462b-739e-4ccc-8838-bd1714dbbc0c None admin] RBAC: Adding query filter params (group.id=879f7fdad40d4670a00f43b0bc463c73, role.id=1ead91d8230c468cabd0637c833c42ac, scope.project.id=83915a029ef141e7a371da8296ea927d) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:53.943643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02462b-739e-4ccc-8838-bd1714dbbc0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:53.945314 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02462b-739e-4ccc-8838-bd1714dbbc0c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:53.951327 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 176/372] 10.222.0.58 () {56 vars in 1376 bytes} [Tue May 17 11:52:53 2022] GET /identity/v3/role_assignments?group.id=879f7fdad40d4670a00f43b0bc463c73&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=1ead91d8230c468cabd0637c833c42ac => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:53.952381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02462b-739e-4ccc-8838-bd1714dbbc0c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:54.044927 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 197/373] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:54.051892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd680201-f833-4d0c-887d-78987db7b272 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:54.075934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02462b-739e-4ccc-8838-bd1714dbbc0c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:54.133505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276125e-8924-4f4e-9ce8-e9cb8cb07094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:54.134181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276125e-8924-4f4e-9ce8-e9cb8cb07094 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:54.134464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276125e-8924-4f4e-9ce8-e9cb8cb07094 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:54.134744 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276125e-8924-4f4e-9ce8-e9cb8cb07094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:54.214825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276125e-8924-4f4e-9ce8-e9cb8cb07094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:54.216821 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276125e-8924-4f4e-9ce8-e9cb8cb07094 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:54.239216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd680201-f833-4d0c-887d-78987db7b272 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:54.277755 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388df3b-4f28-4ebc-9235-cfb67e32c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:54.278976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388df3b-4f28-4ebc-9235-cfb67e32c881 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:54.279463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388df3b-4f28-4ebc-9235-cfb67e32c881 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:54.280832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388df3b-4f28-4ebc-9235-cfb67e32c881 None admin] PATH_INFO: `/v3/projects/2acfce5cbf9f4de7bfe02428af601440` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:54.283074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388df3b-4f28-4ebc-9235-cfb67e32c881 None admin] RBAC: Authorizing `identity:get_project(project_id=2acfce5cbf9f4de7bfe02428af601440)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:54.284752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388df3b-4f28-4ebc-9235-cfb67e32c881 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:54.286963 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 198/374] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:54 2022] GET /identity/v3/projects/2acfce5cbf9f4de7bfe02428af601440 => generated 344 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:54.292059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388df3b-4f28-4ebc-9235-cfb67e32c881 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:54.368866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 177/375] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:52:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:52:54.375221 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276125e-8924-4f4e-9ce8-e9cb8cb07094 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:54.410836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388df3b-4f28-4ebc-9235-cfb67e32c881 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:54.469983 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d02ed-a13b-4cc8-9f01-aeb289f8aaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:54.472615 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d02ed-a13b-4cc8-9f01-aeb289f8aaa9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:54.473113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d02ed-a13b-4cc8-9f01-aeb289f8aaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:54.473634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d02ed-a13b-4cc8-9f01-aeb289f8aaa9 None admin] PATH_INFO: `/v3/groups/ed8d9c13bcec42b2a96f5bdd93fb185f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:54.480742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d02ed-a13b-4cc8-9f01-aeb289f8aaa9 None admin] RBAC: Authorizing `identity:get_group(group_id=ed8d9c13bcec42b2a96f5bdd93fb185f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:54.485084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d02ed-a13b-4cc8-9f01-aeb289f8aaa9 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:54.490257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 199/376] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:52:54 2022] GET /identity/v3/groups/ed8d9c13bcec42b2a96f5bdd93fb185f => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:54.495925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d02ed-a13b-4cc8-9f01-aeb289f8aaa9 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:54.566916 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276125e-8924-4f4e-9ce8-e9cb8cb07094 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:54.603300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb01dd3-9514-4301-8f31-04164aee02b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:54.604560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01dd3-9514-4301-8f31-04164aee02b3 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:54.605047 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01dd3-9514-4301-8f31-04164aee02b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:54.605519 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb01dd3-9514-4301-8f31-04164aee02b3 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:54.606885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb01dd3-9514-4301-8f31-04164aee02b3 None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:54.610962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb01dd3-9514-4301-8f31-04164aee02b3 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:54.613265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 178/377] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:54 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:54.618388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb01dd3-9514-4301-8f31-04164aee02b3 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:54.685394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d02ed-a13b-4cc8-9f01-aeb289f8aaa9 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:54.736881 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be36ee-73d3-4f16-bf7f-211fca9a4194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:54.737478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be36ee-73d3-4f16-bf7f-211fca9a4194 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:54.737763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be36ee-73d3-4f16-bf7f-211fca9a4194 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:54.738038 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be36ee-73d3-4f16-bf7f-211fca9a4194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:54.738882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be36ee-73d3-4f16-bf7f-211fca9a4194 None admin] RBAC: Adding query filter params (group.id=ed8d9c13bcec42b2a96f5bdd93fb185f, role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=2acfce5cbf9f4de7bfe02428af601440) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:54.739196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be36ee-73d3-4f16-bf7f-211fca9a4194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:54.740814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be36ee-73d3-4f16-bf7f-211fca9a4194 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:54.753088 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb01dd3-9514-4301-8f31-04164aee02b3 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:54.758490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 200/378] 10.222.0.58 () {56 vars in 1376 bytes} [Tue May 17 11:52:54 2022] GET /identity/v3/role_assignments?group.id=ed8d9c13bcec42b2a96f5bdd93fb185f&scope.project.id=2acfce5cbf9f4de7bfe02428af601440&role.id=3db33dfd3d6544fd81933007633fc56a => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:54.788736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77c79d-3033-4a91-9bad-02fc312c05c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:54.789972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c79d-3033-4a91-9bad-02fc312c05c3 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:54.790509 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c79d-3033-4a91-9bad-02fc312c05c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:54.791001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c79d-3033-4a91-9bad-02fc312c05c3 None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:54.792719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77c79d-3033-4a91-9bad-02fc312c05c3 None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:54.794488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77c79d-3033-4a91-9bad-02fc312c05c3 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:54.797240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 179/379] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:52:54 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:54.804230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be36ee-73d3-4f16-bf7f-211fca9a4194 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:54.945230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be36ee-73d3-4f16-bf7f-211fca9a4194 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:54.990941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d00099-7b29-43fb-9123-ba4cfc7480b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:54.991900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d00099-7b29-43fb-9123-ba4cfc7480b8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:54.992385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d00099-7b29-43fb-9123-ba4cfc7480b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:54.992870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d00099-7b29-43fb-9123-ba4cfc7480b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:54.993895 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d00099-7b29-43fb-9123-ba4cfc7480b8 None admin] RBAC: Adding query filter params (group.id=879f7fdad40d4670a00f43b0bc463c73, role.id=297b3b3e5982438e9af6c05761718fcc, scope.project.id=83915a029ef141e7a371da8296ea927d) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:54.994396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d00099-7b29-43fb-9123-ba4cfc7480b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:54.996044 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d00099-7b29-43fb-9123-ba4cfc7480b8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:55.008851 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 201/380] 10.222.0.58 () {56 vars in 1376 bytes} [Tue May 17 11:52:54 2022] GET /identity/v3/role_assignments?group.id=879f7fdad40d4670a00f43b0bc463c73&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=297b3b3e5982438e9af6c05761718fcc => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:55.138947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78525-5137-44e8-a91f-ea1be670a9ef None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:55.139326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78525-5137-44e8-a91f-ea1be670a9ef None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:55.139686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78525-5137-44e8-a91f-ea1be670a9ef None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:55.141317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 180/381] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:55.147126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cabe4-9c58-4478-bcfe-caf4adafe7fc None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:55.147435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cabe4-9c58-4478-bcfe-caf4adafe7fc None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:55.147696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cabe4-9c58-4478-bcfe-caf4adafe7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:55.169650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c36cabe4-9c58-4478-bcfe-caf4adafe7fc None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:55.171168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c36cabe4-9c58-4478-bcfe-caf4adafe7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:55.257607 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 202/382] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:55.291665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78525-5137-44e8-a91f-ea1be670a9ef None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:55.425335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78525-5137-44e8-a91f-ea1be670a9ef None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:55.471908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e3a06-e764-4573-bfd5-ffa3e99b46d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:55.472746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e3a06-e764-4573-bfd5-ffa3e99b46d9 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:55.473029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e3a06-e764-4573-bfd5-ffa3e99b46d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:55.473308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e3a06-e764-4573-bfd5-ffa3e99b46d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:55.490737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e3a06-e764-4573-bfd5-ffa3e99b46d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-f39e3a06-e764-4573-bfd5-ffa3e99b46d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:55.498551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:55.499428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:55.500963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:52:55.503014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 181/383] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:55.507960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cabe4-9c58-4478-bcfe-caf4adafe7fc None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:55.665436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cabe4-9c58-4478-bcfe-caf4adafe7fc None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:55.715787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf5e06-aa3c-4a8f-af15-4b69f8f7f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:55.716490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5e06-aa3c-4a8f-af15-4b69f8f7f61a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:55.716769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5e06-aa3c-4a8f-af15-4b69f8f7f61a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:55.717042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5e06-aa3c-4a8f-af15-4b69f8f7f61a None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:55.717792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf5e06-aa3c-4a8f-af15-4b69f8f7f61a None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:55.718095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf5e06-aa3c-4a8f-af15-4b69f8f7f61a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:55.719831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf5e06-aa3c-4a8f-af15-4b69f8f7f61a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:55.728976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 203/384] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:55.734953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e3a06-e764-4573-bfd5-ffa3e99b46d9 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:55.861815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff270-377b-49b6-87bf-c6283e366598 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:55.862103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff270-377b-49b6-87bf-c6283e366598 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:55.862282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fff270-377b-49b6-87bf-c6283e366598 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:55.863940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 204/385] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:55.868797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20944e-b1ed-44c4-b7e1-8f2f06f37f8d None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:55.869083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20944e-b1ed-44c4-b7e1-8f2f06f37f8d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:55.869358 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20944e-b1ed-44c4-b7e1-8f2f06f37f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:55.892756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ba20944e-b1ed-44c4-b7e1-8f2f06f37f8d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:55.894228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ba20944e-b1ed-44c4-b7e1-8f2f06f37f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:55.895199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e3a06-e764-4573-bfd5-ffa3e99b46d9 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:55.938743 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c659e-8908-4b22-97e2-43faf2308e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:55.939602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c659e-8908-4b22-97e2-43faf2308e02 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:55.939881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c659e-8908-4b22-97e2-43faf2308e02 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:55.940921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c659e-8908-4b22-97e2-43faf2308e02 None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:55.943414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c659e-8908-4b22-97e2-43faf2308e02 None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:55.944900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c659e-8908-4b22-97e2-43faf2308e02 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:55.947505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 182/386] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:52:55 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:55.955446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c659e-8908-4b22-97e2-43faf2308e02 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:56.024447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 205/387] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:56.049131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20944e-b1ed-44c4-b7e1-8f2f06f37f8d None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:56.115878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c659e-8908-4b22-97e2-43faf2308e02 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:56.152572 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20944e-b1ed-44c4-b7e1-8f2f06f37f8d None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:56.183792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d608e-b6f8-489a-8625-6319ef482797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:56.184687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d608e-b6f8-489a-8625-6319ef482797 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:56.185273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d608e-b6f8-489a-8625-6319ef482797 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:56.185639 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d608e-b6f8-489a-8625-6319ef482797 None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:56.186880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d608e-b6f8-489a-8625-6319ef482797 None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:56.189200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d608e-b6f8-489a-8625-6319ef482797 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:56.196671 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 183/388] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:55 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:56.197490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d608e-b6f8-489a-8625-6319ef482797 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:56.200896 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5adbb2-b535-431c-b945-fbd2c706f2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:56.201717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5adbb2-b535-431c-b945-fbd2c706f2ff None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:56.201999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5adbb2-b535-431c-b945-fbd2c706f2ff None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:56.202271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5adbb2-b535-431c-b945-fbd2c706f2ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:56.219439 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5adbb2-b535-431c-b945-fbd2c706f2ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-bf5adbb2-b535-431c-b945-fbd2c706f2ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:56.233140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:56.234575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:56.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:56.240210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 206/389] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:52:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:56.242619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5adbb2-b535-431c-b945-fbd2c706f2ff None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:56.362651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d608e-b6f8-489a-8625-6319ef482797 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:56.415923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5adbb2-b535-431c-b945-fbd2c706f2ff None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:56.424626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a032f9c-f918-433d-aa80-58d43b5cd8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:56.425514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a032f9c-f918-433d-aa80-58d43b5cd8cc None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:56.425788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a032f9c-f918-433d-aa80-58d43b5cd8cc None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:56.426057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a032f9c-f918-433d-aa80-58d43b5cd8cc None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662/groups/879f7fdad40d4670a00f43b0bc463c73/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:56.430726 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a032f9c-f918-433d-aa80-58d43b5cd8cc None admin] RBAC: Authorizing `identity:create_grant(project_id=1da154bbce234bbe9e9dfabe1b861662, group_id=879f7fdad40d4670a00f43b0bc463c73, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:56.432166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a032f9c-f918-433d-aa80-58d43b5cd8cc None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:56.459594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 184/390] 10.222.0.58 () {58 vars in 1442 bytes} [Tue May 17 11:52:56 2022] PUT /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662/groups/879f7fdad40d4670a00f43b0bc463c73/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:56.479181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed073f0-80bc-45b5-89ee-d486533a6baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:56.479901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed073f0-80bc-45b5-89ee-d486533a6baa None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:56.480261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed073f0-80bc-45b5-89ee-d486533a6baa None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:56.480578 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed073f0-80bc-45b5-89ee-d486533a6baa None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:56.481371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed073f0-80bc-45b5-89ee-d486533a6baa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:56.481717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed073f0-80bc-45b5-89ee-d486533a6baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:56.483223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed073f0-80bc-45b5-89ee-d486533a6baa None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:56.497088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 207/391] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:52:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:56.504883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a032f9c-f918-433d-aa80-58d43b5cd8cc None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:56.644501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a032f9c-f918-433d-aa80-58d43b5cd8cc None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:56.696133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68cf0c-c8bb-4360-abe9-aee22a4a509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:56.696942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68cf0c-c8bb-4360-abe9-aee22a4a509a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:56.697225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68cf0c-c8bb-4360-abe9-aee22a4a509a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:56.697503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68cf0c-c8bb-4360-abe9-aee22a4a509a None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:56.698771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68cf0c-c8bb-4360-abe9-aee22a4a509a None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:56.700294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68cf0c-c8bb-4360-abe9-aee22a4a509a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:56.701910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 185/392] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:52:56 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:56.707555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed073f0-80bc-45b5-89ee-d486533a6baa None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:56.822923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed073f0-80bc-45b5-89ee-d486533a6baa None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:56.861662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca81c71-59d7-4cdb-b2ff-0cc5282d0dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:56.862576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81c71-59d7-4cdb-b2ff-0cc5282d0dac None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:56.862864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81c71-59d7-4cdb-b2ff-0cc5282d0dac None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:56.863140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81c71-59d7-4cdb-b2ff-0cc5282d0dac None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:56.865233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca81c71-59d7-4cdb-b2ff-0cc5282d0dac None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:56.866746 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca81c71-59d7-4cdb-b2ff-0cc5282d0dac None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:56.868822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 208/393] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:56 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:56.875554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68cf0c-c8bb-4360-abe9-aee22a4a509a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:57.001516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68cf0c-c8bb-4360-abe9-aee22a4a509a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:57.039569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0303f7-886a-4b14-ad95-3f432a1fb4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:57.040489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0303f7-886a-4b14-ad95-3f432a1fb4b1 None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:57.040768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0303f7-886a-4b14-ad95-3f432a1fb4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:57.041044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0303f7-886a-4b14-ad95-3f432a1fb4b1 None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662/groups/879f7fdad40d4670a00f43b0bc463c73/roles/297b3b3e5982438e9af6c05761718fcc` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:57.043261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0303f7-886a-4b14-ad95-3f432a1fb4b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1da154bbce234bbe9e9dfabe1b861662, group_id=879f7fdad40d4670a00f43b0bc463c73, role_id=297b3b3e5982438e9af6c05761718fcc)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:57.044736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0303f7-886a-4b14-ad95-3f432a1fb4b1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:57.069807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 186/394] 10.222.0.58 () {58 vars in 1442 bytes} [Tue May 17 11:52:56 2022] PUT /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662/groups/879f7fdad40d4670a00f43b0bc463c73/roles/297b3b3e5982438e9af6c05761718fcc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:57.212893 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c256d7-28b9-4f9d-9206-f2f90f825b57 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:57.213236 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c256d7-28b9-4f9d-9206-f2f90f825b57 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:57.213458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c256d7-28b9-4f9d-9206-f2f90f825b57 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:57.215095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 209/395] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:57.220874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b53d8b-d47a-4817-8365-6ca90b9cb2bc None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:57.221223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b53d8b-d47a-4817-8365-6ca90b9cb2bc None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:57.221510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b53d8b-d47a-4817-8365-6ca90b9cb2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:57.245676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f2b53d8b-d47a-4817-8365-6ca90b9cb2bc None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:57.246901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f2b53d8b-d47a-4817-8365-6ca90b9cb2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:57.334983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 187/396] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:57.376661 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c256d7-28b9-4f9d-9206-f2f90f825b57 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:57.516964 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c256d7-28b9-4f9d-9206-f2f90f825b57 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:57.562965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92784b73-68ca-4eb1-a3dc-f3c453eed31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:57.563799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92784b73-68ca-4eb1-a3dc-f3c453eed31c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:57.564084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92784b73-68ca-4eb1-a3dc-f3c453eed31c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:57.564387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92784b73-68ca-4eb1-a3dc-f3c453eed31c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:57.583506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92784b73-68ca-4eb1-a3dc-f3c453eed31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-92784b73-68ca-4eb1-a3dc-f3c453eed31c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:57.591709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:57.594104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:57.596221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 210/397] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:57.604049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b53d8b-d47a-4817-8365-6ca90b9cb2bc None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:57.714356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b53d8b-d47a-4817-8365-6ca90b9cb2bc None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:57.759779 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558bd3d-ca37-4365-ac6b-854be5856c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:57.760537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558bd3d-ca37-4365-ac6b-854be5856c62 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:57.760821 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558bd3d-ca37-4365-ac6b-854be5856c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:57.761156 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558bd3d-ca37-4365-ac6b-854be5856c62 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:57.761926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558bd3d-ca37-4365-ac6b-854be5856c62 None admin] RBAC: Adding query filter params (name=member) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:57.762237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558bd3d-ca37-4365-ac6b-854be5856c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:57.763627 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558bd3d-ca37-4365-ac6b-854be5856c62 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:57.776174 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 188/398] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:52:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:57.782150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92784b73-68ca-4eb1-a3dc-f3c453eed31c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:57.804072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5190b1e-5f94-4348-b9dc-775bbffb5614 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:57.804416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5190b1e-5f94-4348-b9dc-775bbffb5614 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:57.804656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5190b1e-5f94-4348-b9dc-775bbffb5614 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:57.806260 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 189/399] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:52:57.813184 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db42b86-69c3-4f8a-9df8-8c1ba7c0fe54 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:57.813445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db42b86-69c3-4f8a-9df8-8c1ba7c0fe54 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:57.813701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db42b86-69c3-4f8a-9df8-8c1ba7c0fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:57.832532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4db42b86-69c3-4f8a-9df8-8c1ba7c0fe54 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:57.833732 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4db42b86-69c3-4f8a-9df8-8c1ba7c0fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:57.916222 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 190/400] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:57.917577 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92784b73-68ca-4eb1-a3dc-f3c453eed31c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:57.917761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b7726-6b98-40dd-b9b4-8a36c35987c3 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:57.917931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b7726-6b98-40dd-b9b4-8a36c35987c3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:57.918148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b7726-6b98-40dd-b9b4-8a36c35987c3 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:57.924420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 191/401] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:57.925722 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aa43d-b783-4351-86e0-101fbf7205c5 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:57.926013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aa43d-b783-4351-86e0-101fbf7205c5 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:57.926295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487aa43d-b783-4351-86e0-101fbf7205c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:57.952581 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-487aa43d-b783-4351-86e0-101fbf7205c5 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:57.954622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-487aa43d-b783-4351-86e0-101fbf7205c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:57.985558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9384-8089-4dde-a16a-25aa4f71db53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:57.986691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9384-8089-4dde-a16a-25aa4f71db53 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:57.987136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9384-8089-4dde-a16a-25aa4f71db53 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:57.987416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9384-8089-4dde-a16a-25aa4f71db53 None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:57.989388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9384-8089-4dde-a16a-25aa4f71db53 None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:57.991599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9384-8089-4dde-a16a-25aa4f71db53 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:57.993974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 211/402] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:52:57 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:52:57.994771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9384-8089-4dde-a16a-25aa4f71db53 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:58.042915 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 192/403] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:52:58.044023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aa43d-b783-4351-86e0-101fbf7205c5 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:58.140542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9384-8089-4dde-a16a-25aa4f71db53 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:58.176298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487aa43d-b783-4351-86e0-101fbf7205c5 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:58.178606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78342b7-8691-4345-af84-1b05ad8fe0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:58.179428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78342b7-8691-4345-af84-1b05ad8fe0b9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:58.179710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78342b7-8691-4345-af84-1b05ad8fe0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:58.179987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78342b7-8691-4345-af84-1b05ad8fe0b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:58.191461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78342b7-8691-4345-af84-1b05ad8fe0b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-a78342b7-8691-4345-af84-1b05ad8fe0b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:58.200898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:58.203395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 212/404] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:52:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:58.205433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78342b7-8691-4345-af84-1b05ad8fe0b9 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:58.216165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc969623-8049-48b3-9139-fee466f3eb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:58.217080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc969623-8049-48b3-9139-fee466f3eb3f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:58.217361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc969623-8049-48b3-9139-fee466f3eb3f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:58.217634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc969623-8049-48b3-9139-fee466f3eb3f None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:58.219528 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc969623-8049-48b3-9139-fee466f3eb3f None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:58.221216 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc969623-8049-48b3-9139-fee466f3eb3f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:58.222890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 193/405] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:58 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:58.228081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc969623-8049-48b3-9139-fee466f3eb3f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:58.354806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc969623-8049-48b3-9139-fee466f3eb3f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:58.361658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78342b7-8691-4345-af84-1b05ad8fe0b9 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:58.393600 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef9a0f-c6d6-4014-8ad7-7d9808071c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:58.394280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9a0f-c6d6-4014-8ad7-7d9808071c16 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:58.394562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9a0f-c6d6-4014-8ad7-7d9808071c16 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:58.394839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9a0f-c6d6-4014-8ad7-7d9808071c16 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:58.395603 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef9a0f-c6d6-4014-8ad7-7d9808071c16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:58.395915 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef9a0f-c6d6-4014-8ad7-7d9808071c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:58.396308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4a86f-c4b8-4bf8-a950-9547a75e872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:58.397171 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4a86f-c4b8-4bf8-a950-9547a75e872c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:58.397339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef9a0f-c6d6-4014-8ad7-7d9808071c16 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:58.397583 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4a86f-c4b8-4bf8-a950-9547a75e872c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:58.397921 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4a86f-c4b8-4bf8-a950-9547a75e872c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:58.407167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 194/406] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:52:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:58.408046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef9a0f-c6d6-4014-8ad7-7d9808071c16 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:58.414082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4a86f-c4b8-4bf8-a950-9547a75e872c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-51d4a86f-c4b8-4bf8-a950-9547a75e872c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:58.422356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:58.423214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:52:58.423981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 213/407] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:52:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:52:58.425155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4a86f-c4b8-4bf8-a950-9547a75e872c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:58.548207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef9a0f-c6d6-4014-8ad7-7d9808071c16 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:58.549768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4a86f-c4b8-4bf8-a950-9547a75e872c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:58.589182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd8e75-324f-45fa-8196-23c20896fa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:58.590373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd8e75-324f-45fa-8196-23c20896fa28 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:58.590663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd8e75-324f-45fa-8196-23c20896fa28 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:58.591226 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd8e75-324f-45fa-8196-23c20896fa28 None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:58.604205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd8e75-324f-45fa-8196-23c20896fa28 None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:58.604205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd8e75-324f-45fa-8196-23c20896fa28 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:58.604205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 214/408] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:52:58 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:58.604205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd8e75-324f-45fa-8196-23c20896fa28 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:58.628230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be600bb3-916c-4df1-a433-63ea542cb783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:58.628230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600bb3-916c-4df1-a433-63ea542cb783 None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:58.628230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600bb3-916c-4df1-a433-63ea542cb783 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:58.628230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be600bb3-916c-4df1-a433-63ea542cb783 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d/groups/879f7fdad40d4670a00f43b0bc463c73/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:58.634023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be600bb3-916c-4df1-a433-63ea542cb783 None admin] RBAC: Authorizing `identity:create_grant(project_id=83915a029ef141e7a371da8296ea927d, group_id=879f7fdad40d4670a00f43b0bc463c73, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:58.634023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be600bb3-916c-4df1-a433-63ea542cb783 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:58.661527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 195/409] 10.222.0.58 () {58 vars in 1442 bytes} [Tue May 17 11:52:58 2022] PUT /identity/v3/projects/83915a029ef141e7a371da8296ea927d/groups/879f7fdad40d4670a00f43b0bc463c73/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:58.662515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be600bb3-916c-4df1-a433-63ea542cb783 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:58.826013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be600bb3-916c-4df1-a433-63ea542cb783 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:58.864101 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd8e75-324f-45fa-8196-23c20896fa28 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:58.864718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a459f7-7119-4ebb-8657-aa62131b92bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:58.865185 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a459f7-7119-4ebb-8657-aa62131b92bc None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:58.866276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a459f7-7119-4ebb-8657-aa62131b92bc None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:58.866276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a459f7-7119-4ebb-8657-aa62131b92bc None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:58.872229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a459f7-7119-4ebb-8657-aa62131b92bc None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:58.872229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a459f7-7119-4ebb-8657-aa62131b92bc None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:58.872229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 196/410] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:58 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:58.880210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a459f7-7119-4ebb-8657-aa62131b92bc None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:59.000753 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245aab4-55cf-4faa-a2a9-9f7c929d88e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:59.001441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245aab4-55cf-4faa-a2a9-9f7c929d88e4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:59.004202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245aab4-55cf-4faa-a2a9-9f7c929d88e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:59.004202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245aab4-55cf-4faa-a2a9-9f7c929d88e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:59.004202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245aab4-55cf-4faa-a2a9-9f7c929d88e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:52:59.004202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245aab4-55cf-4faa-a2a9-9f7c929d88e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:59.005105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a459f7-7119-4ebb-8657-aa62131b92bc None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:59.012671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245aab4-55cf-4faa-a2a9-9f7c929d88e4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:59.038546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 215/411] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:59.045417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245aab4-55cf-4faa-a2a9-9f7c929d88e4 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:59.050333 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87823-de3b-4b65-8157-5c66b1f82ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:59.051291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87823-de3b-4b65-8157-5c66b1f82ab1 None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:59.051574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87823-de3b-4b65-8157-5c66b1f82ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:59.051848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87823-de3b-4b65-8157-5c66b1f82ab1 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d/groups/879f7fdad40d4670a00f43b0bc463c73/roles/297b3b3e5982438e9af6c05761718fcc` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:59.064203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e87823-de3b-4b65-8157-5c66b1f82ab1 None admin] RBAC: Authorizing `identity:create_grant(project_id=83915a029ef141e7a371da8296ea927d, group_id=879f7fdad40d4670a00f43b0bc463c73, role_id=297b3b3e5982438e9af6c05761718fcc)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:59.065742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e87823-de3b-4b65-8157-5c66b1f82ab1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:59.095909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 197/412] 10.222.0.58 () {58 vars in 1442 bytes} [Tue May 17 11:52:58 2022] PUT /identity/v3/projects/83915a029ef141e7a371da8296ea927d/groups/879f7fdad40d4670a00f43b0bc463c73/roles/297b3b3e5982438e9af6c05761718fcc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:59.257966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245aab4-55cf-4faa-a2a9-9f7c929d88e4 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:59.300123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd029ee-b48e-452f-afd0-d031b364e25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:59.301087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd029ee-b48e-452f-afd0-d031b364e25c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:59.301377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd029ee-b48e-452f-afd0-d031b364e25c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:59.301709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd029ee-b48e-452f-afd0-d031b364e25c None admin] PATH_INFO: `/v3/groups/ed8d9c13bcec42b2a96f5bdd93fb185f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:59.302939 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd029ee-b48e-452f-afd0-d031b364e25c None admin] RBAC: Authorizing `identity:get_group(group_id=ed8d9c13bcec42b2a96f5bdd93fb185f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:59.304433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd029ee-b48e-452f-afd0-d031b364e25c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:59.306388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 216/413] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:52:59 2022] GET /identity/v3/groups/ed8d9c13bcec42b2a96f5bdd93fb185f => generated 229 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:59.312210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87823-de3b-4b65-8157-5c66b1f82ab1 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:59.429251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87823-de3b-4b65-8157-5c66b1f82ab1 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:59.465810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32761da8-9c3d-4395-9c1c-581be5b4827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:59.466677 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761da8-9c3d-4395-9c1c-581be5b4827a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:59.466962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761da8-9c3d-4395-9c1c-581be5b4827a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:59.467240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761da8-9c3d-4395-9c1c-581be5b4827a None admin] PATH_INFO: `/v3/projects/2acfce5cbf9f4de7bfe02428af601440` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:59.469034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32761da8-9c3d-4395-9c1c-581be5b4827a None admin] RBAC: Authorizing `identity:get_project(project_id=2acfce5cbf9f4de7bfe02428af601440)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:59.470594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32761da8-9c3d-4395-9c1c-581be5b4827a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:59.472648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 198/414] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:52:59 2022] GET /identity/v3/projects/2acfce5cbf9f4de7bfe02428af601440 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:52:59.478247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd029ee-b48e-452f-afd0-d031b364e25c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:59.583860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd029ee-b48e-452f-afd0-d031b364e25c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:59.617597 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016c2fe-ac4c-4b84-9246-379051f92772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:59.618538 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c2fe-ac4c-4b84-9246-379051f92772 None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:59.618831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c2fe-ac4c-4b84-9246-379051f92772 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:59.619121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c2fe-ac4c-4b84-9246-379051f92772 None admin] PATH_INFO: `/v3/projects/2acfce5cbf9f4de7bfe02428af601440/groups/ed8d9c13bcec42b2a96f5bdd93fb185f/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:59.621096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016c2fe-ac4c-4b84-9246-379051f92772 None admin] RBAC: Authorizing `identity:create_grant(project_id=2acfce5cbf9f4de7bfe02428af601440, group_id=ed8d9c13bcec42b2a96f5bdd93fb185f, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:52:59.622612 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016c2fe-ac4c-4b84-9246-379051f92772 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:52:59.641894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 217/415] 10.222.0.58 () {58 vars in 1442 bytes} [Tue May 17 11:52:59 2022] PUT /identity/v3/projects/2acfce5cbf9f4de7bfe02428af601440/groups/ed8d9c13bcec42b2a96f5bdd93fb185f/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:52:59.672944 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f15c-ff44-46fe-b64a-7181ea57fb3f None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:59.673262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f15c-ff44-46fe-b64a-7181ea57fb3f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:59.673510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f15c-ff44-46fe-b64a-7181ea57fb3f None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:59.675154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 199/416] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:52:59.681431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6a71-76b7-4f21-82a3-d6ed42818d10 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:59.681731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6a71-76b7-4f21-82a3-d6ed42818d10 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:59.682022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6a71-76b7-4f21-82a3-d6ed42818d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:59.701740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c76d6a71-76b7-4f21-82a3-d6ed42818d10 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:52:59.703610 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c76d6a71-76b7-4f21-82a3-d6ed42818d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:52:59.780149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 218/417] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:52:59.804902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566f15c-ff44-46fe-b64a-7181ea57fb3f None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:52:59.932971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566f15c-ff44-46fe-b64a-7181ea57fb3f None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:52:59.969991 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d9bd9-7a24-4acb-a1ca-9fb4201a8545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:52:59.971214 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d9bd9-7a24-4acb-a1ca-9fb4201a8545 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:52:59.971694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d9bd9-7a24-4acb-a1ca-9fb4201a8545 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:52:59.972166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d9bd9-7a24-4acb-a1ca-9fb4201a8545 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:52:59.985950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d9bd9-7a24-4acb-a1ca-9fb4201a8545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-767d9bd9-7a24-4acb-a1ca-9fb4201a8545 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:52:59.994261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:52:59.995171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:52:59.995943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:00.002503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 200/418] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:52:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:00.004878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d6a71-76b7-4f21-82a3-d6ed42818d10 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:00.132798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d6a71-76b7-4f21-82a3-d6ed42818d10 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:00.170767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa90bf-2271-4b4e-b502-1e41f37b804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:00.171999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa90bf-2271-4b4e-b502-1e41f37b804a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:00.172314 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa90bf-2271-4b4e-b502-1e41f37b804a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:00.172590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa90bf-2271-4b4e-b502-1e41f37b804a None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:00.173336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa90bf-2271-4b4e-b502-1e41f37b804a None admin] RBAC: Adding query filter params (name=member) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:00.173638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa90bf-2271-4b4e-b502-1e41f37b804a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:00.175011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa90bf-2271-4b4e-b502-1e41f37b804a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:00.188305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 219/419] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:53:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:00.193722 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d9bd9-7a24-4acb-a1ca-9fb4201a8545 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:00.301265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d9bd9-7a24-4acb-a1ca-9fb4201a8545 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:00.345875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4d231-d3d0-40f7-8ea2-51aab9467709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:00.346524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4d231-d3d0-40f7-8ea2-51aab9467709 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:00.346802 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4d231-d3d0-40f7-8ea2-51aab9467709 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:00.347073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4d231-d3d0-40f7-8ea2-51aab9467709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:00.384997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3c8f1-9b32-48b0-a3e4-788fdc59bf5c None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:00.385316 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3c8f1-9b32-48b0-a3e4-788fdc59bf5c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:00.385545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3c8f1-9b32-48b0-a3e4-788fdc59bf5c None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:00.387155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 220/420] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:00.398098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e9d13-6fc4-41e5-ba40-6688a4d31f1e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:00.398387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e9d13-6fc4-41e5-ba40-6688a4d31f1e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:00.398664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e9d13-6fc4-41e5-ba40-6688a4d31f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:00.427937 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-825e9d13-6fc4-41e5-ba40-6688a4d31f1e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:00.430415 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-825e9d13-6fc4-41e5-ba40-6688a4d31f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:00.461032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4d231-d3d0-40f7-8ea2-51aab9467709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:00.462425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4d231-d3d0-40f7-8ea2-51aab9467709 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:00.579930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 221/421] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:00.632238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e9d13-6fc4-41e5-ba40-6688a4d31f1e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:00.633236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 201/422] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:00.640699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4d231-d3d0-40f7-8ea2-51aab9467709 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:00.776422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4d231-d3d0-40f7-8ea2-51aab9467709 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:00.818906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04477024-8753-48ec-9e5b-06bb0a016133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:00.819778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04477024-8753-48ec-9e5b-06bb0a016133 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:00.820061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04477024-8753-48ec-9e5b-06bb0a016133 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:00.820368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04477024-8753-48ec-9e5b-06bb0a016133 None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:00.824937 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04477024-8753-48ec-9e5b-06bb0a016133 None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:00.826403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04477024-8753-48ec-9e5b-06bb0a016133 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:00.832212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 202/423] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:53:00 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:00.834833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04477024-8753-48ec-9e5b-06bb0a016133 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:00.836714 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e9d13-6fc4-41e5-ba40-6688a4d31f1e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:00.877635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a50b4-c9cf-4a3d-9433-255edeed70b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:00.878827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a50b4-c9cf-4a3d-9433-255edeed70b1 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:00.879299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a50b4-c9cf-4a3d-9433-255edeed70b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:00.879767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a50b4-c9cf-4a3d-9433-255edeed70b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:00.904605 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a50b4-c9cf-4a3d-9433-255edeed70b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-f51a50b4-c9cf-4a3d-9433-255edeed70b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:00.918462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:00.919331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:53:00.920130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:00.924041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 222/424] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:00.930374 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a50b4-c9cf-4a3d-9433-255edeed70b1 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:00.981679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04477024-8753-48ec-9e5b-06bb0a016133 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:01.016522 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6954d-5262-47dd-8149-afdb7ad6feb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:01.017704 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6954d-5262-47dd-8149-afdb7ad6feb9 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:01.018178 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6954d-5262-47dd-8149-afdb7ad6feb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:01.018640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6954d-5262-47dd-8149-afdb7ad6feb9 None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:01.020110 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6954d-5262-47dd-8149-afdb7ad6feb9 None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:01.021760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6954d-5262-47dd-8149-afdb7ad6feb9 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:01.023860 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 203/425] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:53:00 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:01.029620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6954d-5262-47dd-8149-afdb7ad6feb9 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:01.145991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a50b4-c9cf-4a3d-9433-255edeed70b1 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:01.207518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ebe3c-7c94-44f8-b616-329c262e9023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:01.208206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ebe3c-7c94-44f8-b616-329c262e9023 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:01.208503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ebe3c-7c94-44f8-b616-329c262e9023 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:01.208778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ebe3c-7c94-44f8-b616-329c262e9023 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:01.209533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ebe3c-7c94-44f8-b616-329c262e9023 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:01.209844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ebe3c-7c94-44f8-b616-329c262e9023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:01.211237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ebe3c-7c94-44f8-b616-329c262e9023 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:01.215201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6954d-5262-47dd-8149-afdb7ad6feb9 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:01.233887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 223/426] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:01.238820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ebe3c-7c94-44f8-b616-329c262e9023 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:01.274823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c52b67-b5f2-4235-a409-ef2116725150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:01.275492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52b67-b5f2-4235-a409-ef2116725150 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:01.275777 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52b67-b5f2-4235-a409-ef2116725150 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:01.276055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52b67-b5f2-4235-a409-ef2116725150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:01.276984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c52b67-b5f2-4235-a409-ef2116725150 None admin] RBAC: Adding query filter params (group.id=879f7fdad40d4670a00f43b0bc463c73, role.id=1ead91d8230c468cabd0637c833c42ac, scope.project.id=1da154bbce234bbe9e9dfabe1b861662) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:01.277299 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c52b67-b5f2-4235-a409-ef2116725150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:01.278730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c52b67-b5f2-4235-a409-ef2116725150 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:01.285303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 204/427] 10.222.0.58 () {56 vars in 1376 bytes} [Tue May 17 11:53:01 2022] GET /identity/v3/role_assignments?group.id=879f7fdad40d4670a00f43b0bc463c73&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=1ead91d8230c468cabd0637c833c42ac => generated 611 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:01.384918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ebe3c-7c94-44f8-b616-329c262e9023 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:01.427815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c99da-f590-4866-ab1e-f0b0cb03d8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:01.428511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c99da-f590-4866-ab1e-f0b0cb03d8c4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:01.428795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c99da-f590-4866-ab1e-f0b0cb03d8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:01.429073 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c99da-f590-4866-ab1e-f0b0cb03d8c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:01.505555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c99da-f590-4866-ab1e-f0b0cb03d8c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:01.507048 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c99da-f590-4866-ab1e-f0b0cb03d8c4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:01.619108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 224/428] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:01.624378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c52b67-b5f2-4235-a409-ef2116725150 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:01.725975 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c52b67-b5f2-4235-a409-ef2116725150 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:01.769399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e412e-4225-42d3-9578-0138f0cbbcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:01.770296 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e412e-4225-42d3-9578-0138f0cbbcbd None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:01.770576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e412e-4225-42d3-9578-0138f0cbbcbd None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:01.770850 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e412e-4225-42d3-9578-0138f0cbbcbd None admin] PATH_INFO: `/v3/projects/1da154bbce234bbe9e9dfabe1b861662` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:01.772256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e412e-4225-42d3-9578-0138f0cbbcbd None admin] RBAC: Authorizing `identity:get_project(project_id=1da154bbce234bbe9e9dfabe1b861662)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:01.773756 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e412e-4225-42d3-9578-0138f0cbbcbd None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:01.775995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 205/429] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:53:01 2022] GET /identity/v3/projects/1da154bbce234bbe9e9dfabe1b861662 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:01.782277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c99da-f590-4866-ab1e-f0b0cb03d8c4 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:01.890728 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c99da-f590-4866-ab1e-f0b0cb03d8c4 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:01.927782 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b62be-c367-4ffa-bfbc-b84f88afcbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:01.928674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b62be-c367-4ffa-bfbc-b84f88afcbbc None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:01.928956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b62be-c367-4ffa-bfbc-b84f88afcbbc None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:01.929229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b62be-c367-4ffa-bfbc-b84f88afcbbc None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:01.930420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b62be-c367-4ffa-bfbc-b84f88afcbbc None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:01.931869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b62be-c367-4ffa-bfbc-b84f88afcbbc None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:01.933821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 225/430] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:53:01 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:01.942733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e412e-4225-42d3-9578-0138f0cbbcbd None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:01.977100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511ca5d-fb5e-45d2-a73e-920320ef54d0 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:01.977393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511ca5d-fb5e-45d2-a73e-920320ef54d0 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:01.977652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511ca5d-fb5e-45d2-a73e-920320ef54d0 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:01.979139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 226/431] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:53:01.984370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab34af-4035-46e3-8d81-54e7a4d64c75 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:01.984655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab34af-4035-46e3-8d81-54e7a4d64c75 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:01.984932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab34af-4035-46e3-8d81-54e7a4d64c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.002489 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a4ab34af-4035-46e3-8d81-54e7a4d64c75 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:02.003673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a4ab34af-4035-46e3-8d81-54e7a4d64c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:02.069393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e412e-4225-42d3-9578-0138f0cbbcbd None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:02.084221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 227/432] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:53:02.085036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a761-1b53-4ca0-947b-343ac1f21446 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:02.085036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a761-1b53-4ca0-947b-343ac1f21446 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:02.085194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a761-1b53-4ca0-947b-343ac1f21446 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.086569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 228/433] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:02.092840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282d56d-6a06-4e27-aaef-b892791e3295 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:02.093078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282d56d-6a06-4e27-aaef-b892791e3295 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:02.094181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282d56d-6a06-4e27-aaef-b892791e3295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.115043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeb2e1-12ac-4e40-a50b-b37e3812b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:02.115708 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeb2e1-12ac-4e40-a50b-b37e3812b67f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:02.115991 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeb2e1-12ac-4e40-a50b-b37e3812b67f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:02.116304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeb2e1-12ac-4e40-a50b-b37e3812b67f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.117144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eeb2e1-12ac-4e40-a50b-b37e3812b67f None admin] RBAC: Adding query filter params (group.id=879f7fdad40d4670a00f43b0bc463c73, role.id=297b3b3e5982438e9af6c05761718fcc, scope.project.id=1da154bbce234bbe9e9dfabe1b861662) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:02.117460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eeb2e1-12ac-4e40-a50b-b37e3812b67f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:02.119845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eeb2e1-12ac-4e40-a50b-b37e3812b67f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:02.121174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c282d56d-6a06-4e27-aaef-b892791e3295 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:02.123149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c282d56d-6a06-4e27-aaef-b892791e3295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:02.126760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 206/434] 10.222.0.58 () {56 vars in 1376 bytes} [Tue May 17 11:53:01 2022] GET /identity/v3/role_assignments?group.id=879f7fdad40d4670a00f43b0bc463c73&scope.project.id=1da154bbce234bbe9e9dfabe1b861662&role.id=297b3b3e5982438e9af6c05761718fcc => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:02.127652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeb2e1-12ac-4e40-a50b-b37e3812b67f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:02.232220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 229/435] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:02.257099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282d56d-6a06-4e27-aaef-b892791e3295 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:02.265422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeb2e1-12ac-4e40-a50b-b37e3812b67f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:02.317040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba513a6-8b5a-4203-9232-106d723bfd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:02.318563 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba513a6-8b5a-4203-9232-106d723bfd9b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:02.319056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba513a6-8b5a-4203-9232-106d723bfd9b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:02.319725 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba513a6-8b5a-4203-9232-106d723bfd9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.335576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba513a6-8b5a-4203-9232-106d723bfd9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-8ba513a6-8b5a-4203-9232-106d723bfd9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:02.344727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:02.345623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 11:53:02.346540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:02.353393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 207/436] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:02.354835 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba513a6-8b5a-4203-9232-106d723bfd9b None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:02.386878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282d56d-6a06-4e27-aaef-b892791e3295 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:02.424078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f5530-ceaf-415e-afb4-927e76a95256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:02.424915 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f5530-ceaf-415e-afb4-927e76a95256 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:02.425202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f5530-ceaf-415e-afb4-927e76a95256 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:02.425468 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f5530-ceaf-415e-afb4-927e76a95256 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.436906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f5530-ceaf-415e-afb4-927e76a95256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-332f5530-ceaf-415e-afb4-927e76a95256 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:02.445813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:02.446805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:53:02.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:02.449783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 230/437] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:02.451857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f5c9f-07c8-4aae-b233-85bd19dcbed4 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:02.452347 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f5c9f-07c8-4aae-b233-85bd19dcbed4 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:02.452957 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f5c9f-07c8-4aae-b233-85bd19dcbed4 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.454665 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 231/438] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:02.456103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f5c9f-07c8-4aae-b233-85bd19dcbed4 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:02.477887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba513a6-8b5a-4203-9232-106d723bfd9b None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:02.514804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5bce2-633c-489a-bc43-d6df81ae865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:02.515935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5bce2-633c-489a-bc43-d6df81ae865c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:02.516242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5bce2-633c-489a-bc43-d6df81ae865c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:02.516807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5bce2-633c-489a-bc43-d6df81ae865c None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.518154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5bce2-633c-489a-bc43-d6df81ae865c None admin] RBAC: Adding query filter params (name=member) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:02.518154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5bce2-633c-489a-bc43-d6df81ae865c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:02.519339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5bce2-633c-489a-bc43-d6df81ae865c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:02.527996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 208/439] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:53:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:02.533586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b9d6c-f5f2-42f2-b0d2-b7ac62b3e420 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:02.535534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b9d6c-f5f2-42f2-b0d2-b7ac62b3e420 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:02.535534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b9d6c-f5f2-42f2-b0d2-b7ac62b3e420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.552897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-887b9d6c-f5f2-42f2-b0d2-b7ac62b3e420 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:02.554301 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-887b9d6c-f5f2-42f2-b0d2-b7ac62b3e420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:02.582899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f5c9f-07c8-4aae-b233-85bd19dcbed4 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:02.618287 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be480fb7-38bf-4e37-b090-3f0bef20909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:02.618951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480fb7-38bf-4e37-b090-3f0bef20909b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:02.619237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480fb7-38bf-4e37-b090-3f0bef20909b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:02.619522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be480fb7-38bf-4e37-b090-3f0bef20909b None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.620287 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be480fb7-38bf-4e37-b090-3f0bef20909b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:02.620598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be480fb7-38bf-4e37-b090-3f0bef20909b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:02.621980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be480fb7-38bf-4e37-b090-3f0bef20909b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:02.623629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 209/440] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:02.625688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b9d6c-f5f2-42f2-b0d2-b7ac62b3e420 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:02.632363 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 232/441] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:02.637716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be480fb7-38bf-4e37-b090-3f0bef20909b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:02.723254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b9d6c-f5f2-42f2-b0d2-b7ac62b3e420 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:02.732035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be480fb7-38bf-4e37-b090-3f0bef20909b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:02.759352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31923726-d05e-4cd5-975a-9ed65f557b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:02.760009 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31923726-d05e-4cd5-975a-9ed65f557b7c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:02.760316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31923726-d05e-4cd5-975a-9ed65f557b7c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:02.760595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31923726-d05e-4cd5-975a-9ed65f557b7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.763852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4b98-cba5-4b22-87f8-987a16edd5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:02.764531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4b98-cba5-4b22-87f8-987a16edd5d0 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:02.764866 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4b98-cba5-4b22-87f8-987a16edd5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:02.765249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4b98-cba5-4b22-87f8-987a16edd5d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:02.825353 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31923726-d05e-4cd5-975a-9ed65f557b7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:02.826799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31923726-d05e-4cd5-975a-9ed65f557b7c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:02.833089 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd4b98-cba5-4b22-87f8-987a16edd5d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:02.834520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd4b98-cba5-4b22-87f8-987a16edd5d0 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:02.919973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 210/442] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:02.920862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31923726-d05e-4cd5-975a-9ed65f557b7c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:02.928643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 233/443] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 11:53:02.929466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4b98-cba5-4b22-87f8-987a16edd5d0 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:03.013112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31923726-d05e-4cd5-975a-9ed65f557b7c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:03.021135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4b98-cba5-4b22-87f8-987a16edd5d0 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:03.045773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03187cb-5c76-4f30-b27c-fbde951e4718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:03.046778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03187cb-5c76-4f30-b27c-fbde951e4718 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:03.047070 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03187cb-5c76-4f30-b27c-fbde951e4718 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:03.047351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03187cb-5c76-4f30-b27c-fbde951e4718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:03.053502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cb8a8-62ef-43c2-972e-420424fc667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:03.054339 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb8a8-62ef-43c2-972e-420424fc667f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:03.054616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb8a8-62ef-43c2-972e-420424fc667f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:03.054882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cb8a8-62ef-43c2-972e-420424fc667f None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:03.056037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cb8a8-62ef-43c2-972e-420424fc667f None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:03.057202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03187cb-5c76-4f30-b27c-fbde951e4718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:03.057517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cb8a8-62ef-43c2-972e-420424fc667f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:03.059164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 234/444] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:53:02 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:03.059907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cb8a8-62ef-43c2-972e-420424fc667f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-b03187cb-5c76-4f30-b27c-fbde951e4718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:03.065628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:03.066667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:03.067446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 211/445] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:03.068071 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03187cb-5c76-4f30-b27c-fbde951e4718 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:03.153248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cb8a8-62ef-43c2-972e-420424fc667f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:03.162574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03187cb-5c76-4f30-b27c-fbde951e4718 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:03.185240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959a902-9799-48e7-9d12-928fdc2e18d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:03.186061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959a902-9799-48e7-9d12-928fdc2e18d6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:03.186337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959a902-9799-48e7-9d12-928fdc2e18d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:03.186612 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959a902-9799-48e7-9d12-928fdc2e18d6 None admin] PATH_INFO: `/v3/projects/83915a029ef141e7a371da8296ea927d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:03.187985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959a902-9799-48e7-9d12-928fdc2e18d6 None admin] RBAC: Authorizing `identity:get_project(project_id=83915a029ef141e7a371da8296ea927d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:03.189457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959a902-9799-48e7-9d12-928fdc2e18d6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:03.191111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 235/446] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:53:03 2022] GET /identity/v3/projects/83915a029ef141e7a371da8296ea927d => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:03.191864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959a902-9799-48e7-9d12-928fdc2e18d6 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:03.193888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccf07e-1a10-49c5-ad83-443e867d17b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:03.194730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf07e-1a10-49c5-ad83-443e867d17b5 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:03.195014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf07e-1a10-49c5-ad83-443e867d17b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:03.195347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf07e-1a10-49c5-ad83-443e867d17b5 None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:03.196504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccf07e-1a10-49c5-ad83-443e867d17b5 None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:03.197945 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccf07e-1a10-49c5-ad83-443e867d17b5 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:03.199537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 212/447] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:53:03 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:03.200309 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccf07e-1a10-49c5-ad83-443e867d17b5 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:03.288383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959a902-9799-48e7-9d12-928fdc2e18d6 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:03.292825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccf07e-1a10-49c5-ad83-443e867d17b5 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:03.320158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9326e-8bc0-4cd7-9ff1-c43af863f1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:03.320848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9326e-8bc0-4cd7-9ff1-c43af863f1e1 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:03.321130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9326e-8bc0-4cd7-9ff1-c43af863f1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:03.321407 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9326e-8bc0-4cd7-9ff1-c43af863f1e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:03.322146 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9326e-8bc0-4cd7-9ff1-c43af863f1e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:03.322452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9326e-8bc0-4cd7-9ff1-c43af863f1e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:03.323815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9326e-8bc0-4cd7-9ff1-c43af863f1e1 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:03.324401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff86a9-8161-46e7-a06d-ae85cf48eeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:03.325229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff86a9-8161-46e7-a06d-ae85cf48eeb7 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:03.325506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff86a9-8161-46e7-a06d-ae85cf48eeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:03.325785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff86a9-8161-46e7-a06d-ae85cf48eeb7 None admin] PATH_INFO: `/v3/groups/879f7fdad40d4670a00f43b0bc463c73` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:03.326923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff86a9-8161-46e7-a06d-ae85cf48eeb7 None admin] RBAC: Authorizing `identity:get_group(group_id=879f7fdad40d4670a00f43b0bc463c73)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:03.328714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff86a9-8161-46e7-a06d-ae85cf48eeb7 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:03.330500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 213/448] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:53:03 2022] GET /identity/v3/groups/879f7fdad40d4670a00f43b0bc463c73 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:03.331034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff86a9-8161-46e7-a06d-ae85cf48eeb7 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:03.331513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 236/449] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:03.335903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9326e-8bc0-4cd7-9ff1-c43af863f1e1 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:03.427452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9326e-8bc0-4cd7-9ff1-c43af863f1e1 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:03.427942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff86a9-8161-46e7-a06d-ae85cf48eeb7 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:03.461021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf278-c36b-486d-bad0-02724fbbfcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:03.461669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf278-c36b-486d-bad0-02724fbbfcb8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:03.461953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf278-c36b-486d-bad0-02724fbbfcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:03.462052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de02c-b951-4bc5-82a3-aa8c74f07b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:03.462230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf278-c36b-486d-bad0-02724fbbfcb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:03.462599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de02c-b951-4bc5-82a3-aa8c74f07b77 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:03.462884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de02c-b951-4bc5-82a3-aa8c74f07b77 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:03.463050 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf278-c36b-486d-bad0-02724fbbfcb8 None admin] RBAC: Adding query filter params (group.id=879f7fdad40d4670a00f43b0bc463c73, role.id=297b3b3e5982438e9af6c05761718fcc, scope.project.id=83915a029ef141e7a371da8296ea927d) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:03.463158 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de02c-b951-4bc5-82a3-aa8c74f07b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:03.463362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf278-c36b-486d-bad0-02724fbbfcb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:03.463981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2de02c-b951-4bc5-82a3-aa8c74f07b77 None admin] RBAC: Adding query filter params (group.id=879f7fdad40d4670a00f43b0bc463c73, role.id=1ead91d8230c468cabd0637c833c42ac, scope.project.id=83915a029ef141e7a371da8296ea927d) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:03.464323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2de02c-b951-4bc5-82a3-aa8c74f07b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:03.464827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf278-c36b-486d-bad0-02724fbbfcb8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:03.465745 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2de02c-b951-4bc5-82a3-aa8c74f07b77 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:03.470509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 237/450] 10.222.0.58 () {56 vars in 1376 bytes} [Tue May 17 11:53:03 2022] GET /identity/v3/role_assignments?group.id=879f7fdad40d4670a00f43b0bc463c73&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=297b3b3e5982438e9af6c05761718fcc => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:03.471354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf278-c36b-486d-bad0-02724fbbfcb8 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:03.471926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 214/451] 10.222.0.58 () {56 vars in 1376 bytes} [Tue May 17 11:53:03 2022] GET /identity/v3/role_assignments?group.id=879f7fdad40d4670a00f43b0bc463c73&scope.project.id=83915a029ef141e7a371da8296ea927d&role.id=1ead91d8230c468cabd0637c833c42ac => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:03.593022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf278-c36b-486d-bad0-02724fbbfcb8 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:03.630715 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecdc51-3381-4192-9651-2682e7f6cd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:03.631384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecdc51-3381-4192-9651-2682e7f6cd4e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:03.631667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecdc51-3381-4192-9651-2682e7f6cd4e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:03.631941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecdc51-3381-4192-9651-2682e7f6cd4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:03.704944 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecdc51-3381-4192-9651-2682e7f6cd4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:03.706769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ecdc51-3381-4192-9651-2682e7f6cd4e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:03.803180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 238/452] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:03.809011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de02c-b951-4bc5-82a3-aa8c74f07b77 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:03.908870 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de02c-b951-4bc5-82a3-aa8c74f07b77 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:03.942996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b95b6-37aa-454d-bb90-c775b9bccbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:03.943860 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b95b6-37aa-454d-bb90-c775b9bccbde None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:03.944142 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b95b6-37aa-454d-bb90-c775b9bccbde None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:03.944449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b95b6-37aa-454d-bb90-c775b9bccbde None admin] PATH_INFO: `/v3/projects/2acfce5cbf9f4de7bfe02428af601440` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:03.945645 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b95b6-37aa-454d-bb90-c775b9bccbde None admin] RBAC: Authorizing `identity:get_project(project_id=2acfce5cbf9f4de7bfe02428af601440)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:03.947076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b95b6-37aa-454d-bb90-c775b9bccbde None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:03.948828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 215/453] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:53:03 2022] GET /identity/v3/projects/2acfce5cbf9f4de7bfe02428af601440 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:03.954559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecdc51-3381-4192-9651-2682e7f6cd4e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:04.050408 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ecdc51-3381-4192-9651-2682e7f6cd4e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:04.081278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1716b-70ff-4566-9cf3-81d503313636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:04.082106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1716b-70ff-4566-9cf3-81d503313636 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:04.082385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1716b-70ff-4566-9cf3-81d503313636 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:04.082653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1716b-70ff-4566-9cf3-81d503313636 None admin] PATH_INFO: `/v3/groups/ed8d9c13bcec42b2a96f5bdd93fb185f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:04.083783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1716b-70ff-4566-9cf3-81d503313636 None admin] RBAC: Authorizing `identity:get_group(group_id=ed8d9c13bcec42b2a96f5bdd93fb185f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:04.085259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1716b-70ff-4566-9cf3-81d503313636 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:04.086836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 239/454] 10.222.0.58 () {56 vars in 1180 bytes} [Tue May 17 11:53:03 2022] GET /identity/v3/groups/ed8d9c13bcec42b2a96f5bdd93fb185f => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:04.092674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b95b6-37aa-454d-bb90-c775b9bccbde None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:04.185379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b95b6-37aa-454d-bb90-c775b9bccbde None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:04.215657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceb22f-f071-4eca-9a34-1a8974871805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:04.216335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb22f-f071-4eca-9a34-1a8974871805 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:04.216618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb22f-f071-4eca-9a34-1a8974871805 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:04.216892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceb22f-f071-4eca-9a34-1a8974871805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:04.217719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceb22f-f071-4eca-9a34-1a8974871805 None admin] RBAC: Adding query filter params (group.id=ed8d9c13bcec42b2a96f5bdd93fb185f, role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=2acfce5cbf9f4de7bfe02428af601440) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:04.218031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceb22f-f071-4eca-9a34-1a8974871805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:04.219986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceb22f-f071-4eca-9a34-1a8974871805 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:04.225955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 216/455] 10.222.0.58 () {56 vars in 1376 bytes} [Tue May 17 11:53:04 2022] GET /identity/v3/role_assignments?group.id=ed8d9c13bcec42b2a96f5bdd93fb185f&scope.project.id=2acfce5cbf9f4de7bfe02428af601440&role.id=3db33dfd3d6544fd81933007633fc56a => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:06.927137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f0abb-c1fd-4ea6-9d71-261144519cf3 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:06.928091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f0abb-c1fd-4ea6-9d71-261144519cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:06.928615 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f0abb-c1fd-4ea6-9d71-261144519cf3 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:06.930367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 240/456] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:06.936135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a42bd-5aa7-48c4-b958-dda795c80fbd None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:06.937531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a42bd-5aa7-48c4-b958-dda795c80fbd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:06.938059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a42bd-5aa7-48c4-b958-dda795c80fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:06.958104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a14a42bd-5aa7-48c4-b958-dda795c80fbd None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:06.959283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a14a42bd-5aa7-48c4-b958-dda795c80fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:07.054096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 217/457] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:53:07.083787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f0abb-c1fd-4ea6-9d71-261144519cf3 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:07.086122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37cdfd-77b8-4606-9a52-f98a44a689b3 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:07.086411 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37cdfd-77b8-4606-9a52-f98a44a689b3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:07.086682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37cdfd-77b8-4606-9a52-f98a44a689b3 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:07.088324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 218/458] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:07.093673 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f327a-25ed-4d5a-94f5-fd5da0432968 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:07.093961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f327a-25ed-4d5a-94f5-fd5da0432968 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:07.094235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f327a-25ed-4d5a-94f5-fd5da0432968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:07.117045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-0f6f327a-25ed-4d5a-94f5-fd5da0432968 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:07.118216 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0f6f327a-25ed-4d5a-94f5-fd5da0432968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:07.242946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 219/459] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:53:07.250131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f0abb-c1fd-4ea6-9d71-261144519cf3 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:07.279302 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f327a-25ed-4d5a-94f5-fd5da0432968 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:07.304105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024e3b6-f9f0-4c8d-9821-a0f783a609d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:07.304935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024e3b6-f9f0-4c8d-9821-a0f783a609d1 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:07.305211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024e3b6-f9f0-4c8d-9821-a0f783a609d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:07.305482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024e3b6-f9f0-4c8d-9821-a0f783a609d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:07.322163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024e3b6-f9f0-4c8d-9821-a0f783a609d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:07.323613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024e3b6-f9f0-4c8d-9821-a0f783a609d1 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-8024e3b6-f9f0-4c8d-9821-a0f783a609d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:07.352286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:07.353215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:07.354105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:07.354105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:07.354105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:07.354105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:07.355002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 241/460] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:07.361973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024e3b6-f9f0-4c8d-9821-a0f783a609d1 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:07.452487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f327a-25ed-4d5a-94f5-fd5da0432968 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:07.502416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a233b8d-e7b8-405b-8b75-0b750953eb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:07.503399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233b8d-e7b8-405b-8b75-0b750953eb56 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:07.503683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233b8d-e7b8-405b-8b75-0b750953eb56 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:07.503959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a233b8d-e7b8-405b-8b75-0b750953eb56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:07.511078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024e3b6-f9f0-4c8d-9821-a0f783a609d1 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:07.524273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a233b8d-e7b8-405b-8b75-0b750953eb56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:07.524439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a233b8d-e7b8-405b-8b75-0b750953eb56 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-0a233b8d-e7b8-405b-8b75-0b750953eb56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:07.548041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:07.548924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:07.549738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:07.549738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:07.549738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:07.549738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:07.551917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 220/461] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:07.553546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3c75e-f9b0-41d4-abe9-d8e01c97c581 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:07.554051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3c75e-f9b0-41d4-abe9-d8e01c97c581 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:07.554493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3c75e-f9b0-41d4-abe9-d8e01c97c581 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:07.556073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 221/462] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:07.560438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c85be7-694e-4cee-9545-c8b4c12a1296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:07.560438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85be7-694e-4cee-9545-c8b4c12a1296 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:07.560438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85be7-694e-4cee-9545-c8b4c12a1296 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:07.560438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85be7-694e-4cee-9545-c8b4c12a1296 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:07.560756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c85be7-694e-4cee-9545-c8b4c12a1296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:07.560756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c85be7-694e-4cee-9545-c8b4c12a1296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:07.561940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c85be7-694e-4cee-9545-c8b4c12a1296 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:07.562126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3c75e-f9b0-41d4-abe9-d8e01c97c581 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:07.578160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 242/463] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:07.580390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847d12-1634-48a5-a87a-b4801f8601a3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:07.580836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847d12-1634-48a5-a87a-b4801f8601a3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:07.581125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847d12-1634-48a5-a87a-b4801f8601a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:07.603026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2b847d12-1634-48a5-a87a-b4801f8601a3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:07.604277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2b847d12-1634-48a5-a87a-b4801f8601a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:07.673025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3c75e-f9b0-41d4-abe9-d8e01c97c581 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:07.678540 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 243/464] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:07.679450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b847d12-1634-48a5-a87a-b4801f8601a3 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:07.709243 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d114871-fba1-4edc-98bc-b4c6e904ecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:07.710244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114871-fba1-4edc-98bc-b4c6e904ecbd None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:07.710816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114871-fba1-4edc-98bc-b4c6e904ecbd None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:07.711328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114871-fba1-4edc-98bc-b4c6e904ecbd None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:07.712331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d114871-fba1-4edc-98bc-b4c6e904ecbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:07.712830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d114871-fba1-4edc-98bc-b4c6e904ecbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:07.714589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d114871-fba1-4edc-98bc-b4c6e904ecbd None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:07.727135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 222/465] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:07.728350 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d114871-fba1-4edc-98bc-b4c6e904ecbd None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:07.784242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b847d12-1634-48a5-a87a-b4801f8601a3 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:07.820314 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165049a-9417-4b8a-b69d-12cebc7924c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:07.820986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165049a-9417-4b8a-b69d-12cebc7924c1 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:07.821274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165049a-9417-4b8a-b69d-12cebc7924c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:07.821553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165049a-9417-4b8a-b69d-12cebc7924c1 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:07.822249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165049a-9417-4b8a-b69d-12cebc7924c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:07.823710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165049a-9417-4b8a-b69d-12cebc7924c1 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:07.834508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d114871-fba1-4edc-98bc-b4c6e904ecbd None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:07.843789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 244/466] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:53:07 2022] POST /identity/v3/users => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:53:07.844449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165049a-9417-4b8a-b69d-12cebc7924c1 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:07.882132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d470892-6683-4182-a686-30125a757b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:07.883304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d470892-6683-4182-a686-30125a757b24 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:07.884164 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d470892-6683-4182-a686-30125a757b24 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:07.884551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d470892-6683-4182-a686-30125a757b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:07.901713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d470892-6683-4182-a686-30125a757b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:07.903681 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d470892-6683-4182-a686-30125a757b24 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-1d470892-6683-4182-a686-30125a757b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:07.929173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:07.930092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:07.930934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:07.930934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:07.930934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:07.930934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:07.933329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 223/467] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:07.934957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf7e66-7906-429b-ab31-3ff63b0ad118 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:07.935696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf7e66-7906-429b-ab31-3ff63b0ad118 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:07.936159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf7e66-7906-429b-ab31-3ff63b0ad118 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:07.938536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 224/468] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:07.939501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf7e66-7906-429b-ab31-3ff63b0ad118 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:07.976238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165049a-9417-4b8a-b69d-12cebc7924c1 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:08.014004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da4ef-1322-4020-8a1e-78c1bc4efda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:08.014695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da4ef-1322-4020-8a1e-78c1bc4efda4 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:08.015193 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da4ef-1322-4020-8a1e-78c1bc4efda4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:08.015364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da4ef-1322-4020-8a1e-78c1bc4efda4 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:08.016774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7da4ef-1322-4020-8a1e-78c1bc4efda4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:08.018289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7da4ef-1322-4020-8a1e-78c1bc4efda4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:08.048306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 245/469] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:53:07 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:53:08.048306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d42d2-837c-4abc-97d6-c7e30d740ff1 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:08.048306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d42d2-837c-4abc-97d6-c7e30d740ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:08.048306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d42d2-837c-4abc-97d6-c7e30d740ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:08.061588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf7e66-7906-429b-ab31-3ff63b0ad118 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:08.069405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ab9d42d2-837c-4abc-97d6-c7e30d740ff1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:08.070684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ab9d42d2-837c-4abc-97d6-c7e30d740ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:08.104002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5c005-1b0b-4444-b56c-6cbd3666725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:08.104780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c005-1b0b-4444-b56c-6cbd3666725f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:08.105064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c005-1b0b-4444-b56c-6cbd3666725f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:08.105341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5c005-1b0b-4444-b56c-6cbd3666725f None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:08.106118 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5c005-1b0b-4444-b56c-6cbd3666725f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:08.106527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5c005-1b0b-4444-b56c-6cbd3666725f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:08.108007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5c005-1b0b-4444-b56c-6cbd3666725f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:08.124332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 225/470] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:08.130636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5c005-1b0b-4444-b56c-6cbd3666725f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:08.167802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 246/471] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:08.195066 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d42d2-837c-4abc-97d6-c7e30d740ff1 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:08.255853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5c005-1b0b-4444-b56c-6cbd3666725f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:08.302303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74cbe-5e56-4e79-931e-6c7586845ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:08.302897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74cbe-5e56-4e79-931e-6c7586845ded None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:08.303176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74cbe-5e56-4e79-931e-6c7586845ded None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:08.303448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74cbe-5e56-4e79-931e-6c7586845ded None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:08.304149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f74cbe-5e56-4e79-931e-6c7586845ded None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:08.305668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f74cbe-5e56-4e79-931e-6c7586845ded None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:08.332740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 226/472] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:53:08 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:53:08.333999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d42d2-837c-4abc-97d6-c7e30d740ff1 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:08.382208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd416e4-5c00-4c68-a84b-659042fde5f4 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:08.382523 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd416e4-5c00-4c68-a84b-659042fde5f4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:08.382771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd416e4-5c00-4c68-a84b-659042fde5f4 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:08.383115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33babb-ef9b-4415-a72c-0665e68f2b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:08.384279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33babb-ef9b-4415-a72c-0665e68f2b29 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:08.384764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33babb-ef9b-4415-a72c-0665e68f2b29 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:08.384864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 227/473] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:53:08.385313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33babb-ef9b-4415-a72c-0665e68f2b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:08.390707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceead96-23f0-49ab-a8be-791d2aa6e667 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:08.391052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceead96-23f0-49ab-a8be-791d2aa6e667 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:08.391340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceead96-23f0-49ab-a8be-791d2aa6e667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:08.399337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33babb-ef9b-4415-a72c-0665e68f2b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:08.401316 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33babb-ef9b-4415-a72c-0665e68f2b29 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:08.420946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-aceead96-23f0-49ab-a8be-791d2aa6e667 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:08.422818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-aceead96-23f0-49ab-a8be-791d2aa6e667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-cf33babb-ef9b-4415-a72c-0665e68f2b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:08.427882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:08.428799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:08.429625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:08.429625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:08.429625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:08.429625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:08.432809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 247/474] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:08.441189 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33babb-ef9b-4415-a72c-0665e68f2b29 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:08.506957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 228/475] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:53:08.541041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceead96-23f0-49ab-a8be-791d2aa6e667 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:08.571907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33babb-ef9b-4415-a72c-0665e68f2b29 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:08.607520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8b27b-c243-445a-8b1d-50a5973c09d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:08.608627 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8b27b-c243-445a-8b1d-50a5973c09d7 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:08.609879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8b27b-c243-445a-8b1d-50a5973c09d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:08.610361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8b27b-c243-445a-8b1d-50a5973c09d7 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:08.611284 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8b27b-c243-445a-8b1d-50a5973c09d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:08.611804 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8b27b-c243-445a-8b1d-50a5973c09d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:08.613426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8b27b-c243-445a-8b1d-50a5973c09d7 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:08.626442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 248/476] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:08.632320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8b27b-c243-445a-8b1d-50a5973c09d7 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:08.648508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceead96-23f0-49ab-a8be-791d2aa6e667 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:08.698163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d343d-aab0-4c2d-b845-b6289fbaac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:08.698845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d343d-aab0-4c2d-b845-b6289fbaac57 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:08.699146 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d343d-aab0-4c2d-b845-b6289fbaac57 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:08.699450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d343d-aab0-4c2d-b845-b6289fbaac57 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:08.700137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d343d-aab0-4c2d-b845-b6289fbaac57 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:08.701540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d343d-aab0-4c2d-b845-b6289fbaac57 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:08.709488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.sql.core [None req-607d343d-aab0-4c2d-b845-b6289fbaac57 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 11:53:08.709488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 11:53:08.709488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [parameters: {'id': 'a9bac59c022d4aaa937dd759869110c7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 11:53:08.709488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79871) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-607d343d-aab0-4c2d-b845-b6289fbaac57 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application result = self._query(query) May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application conn.query(q) May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application result.read() May 17 11:53:08.727827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return ref.to_dict() May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 11:53:08.728820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application next(self.gen) May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application yield resource May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application next(self.gen) May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self.session.rollback() May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self.force_reraise() May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise self.value May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application session.commit() May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 11:53:08.730166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._prepare_impl() May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self.session.flush() May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._flush(objects) May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application compat.raise_( May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application flush_context.execute() May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rec.execute(self) May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 11:53:08.731241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 11:53:08.732224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application result = self._query(query) May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application conn.query(q) May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application result.read() May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 11:53:08.733020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [parameters: {'id': 'a9bac59c022d4aaa937dd759869110c7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:08.735269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 11:53:08.737292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:08.739294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 229/477] 10.222.0.58 () {60 vars in 1131 bytes} [Tue May 17 11:53:08 2022] POST /identity/v3/roles => generated 144 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:08.739294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d343d-aab0-4c2d-b845-b6289fbaac57 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:08.760732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8b27b-c243-445a-8b1d-50a5973c09d7 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:08.797844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0c614-1b80-47f3-b182-2eaed338b6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:08.799347 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0c614-1b80-47f3-b182-2eaed338b6c9 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:08.800158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0c614-1b80-47f3-b182-2eaed338b6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:08.800659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0c614-1b80-47f3-b182-2eaed338b6c9 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:08.802009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0c614-1b80-47f3-b182-2eaed338b6c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:08.803981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0c614-1b80-47f3-b182-2eaed338b6c9 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:08.836433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 249/478] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:53:08 2022] POST /identity/v3/users => generated 249 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:53:08.850478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d343d-aab0-4c2d-b845-b6289fbaac57 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:08.889156 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766adb03-12ff-487b-ae0f-2a5001fbbb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:08.890051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766adb03-12ff-487b-ae0f-2a5001fbbb71 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:08.890905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766adb03-12ff-487b-ae0f-2a5001fbbb71 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:08.891185 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766adb03-12ff-487b-ae0f-2a5001fbbb71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:08.910393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766adb03-12ff-487b-ae0f-2a5001fbbb71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-766adb03-12ff-487b-ae0f-2a5001fbbb71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:08.918776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:08.919731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:08.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 230/479] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:08.926883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0c614-1b80-47f3-b182-2eaed338b6c9 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:09.073270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0c614-1b80-47f3-b182-2eaed338b6c9 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:09.108239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcba285-e3eb-4281-9acf-3aa7e5f2200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:09.108984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcba285-e3eb-4281-9acf-3aa7e5f2200c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:09.109309 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcba285-e3eb-4281-9acf-3aa7e5f2200c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:09.109625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcba285-e3eb-4281-9acf-3aa7e5f2200c None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:09.110412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcba285-e3eb-4281-9acf-3aa7e5f2200c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:09.110722 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcba285-e3eb-4281-9acf-3aa7e5f2200c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:09.112114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcba285-e3eb-4281-9acf-3aa7e5f2200c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:09.120749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 250/480] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:10.667340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884557e4-f6f4-43ec-8b05-7c545cd68d85 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:10.668336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884557e4-f6f4-43ec-8b05-7c545cd68d85 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:10.668808 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884557e4-f6f4-43ec-8b05-7c545cd68d85 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:10.670616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 231/481] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:10.688968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a2d18-485b-4813-b9ad-d19c319971d2 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:10.689417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a2d18-485b-4813-b9ad-d19c319971d2 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:10.689598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a2d18-485b-4813-b9ad-d19c319971d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:10.708212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-8b6a2d18-485b-4813-b9ad-d19c319971d2 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:10.709500 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-8b6a2d18-485b-4813-b9ad-d19c319971d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:10.794800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 251/482] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:10.831852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884557e4-f6f4-43ec-8b05-7c545cd68d85 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:10.964881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884557e4-f6f4-43ec-8b05-7c545cd68d85 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:11.008576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4b73b-8ed4-4d97-9b2d-d40093d0715e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:11.009375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4b73b-8ed4-4d97-9b2d-d40093d0715e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.009609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e654f2f-7e5d-4325-af28-ea47983f61b5 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.009709 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4b73b-8ed4-4d97-9b2d-d40093d0715e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.009910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4b73b-8ed4-4d97-9b2d-d40093d0715e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.010411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e654f2f-7e5d-4325-af28-ea47983f61b5 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.010946 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e654f2f-7e5d-4325-af28-ea47983f61b5 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.016560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 252/483] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:11.022308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a48707-0e35-4ce8-a2c6-c5e497e3e071 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.022813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a48707-0e35-4ce8-a2c6-c5e497e3e071 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.023299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a48707-0e35-4ce8-a2c6-c5e497e3e071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.024441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4b73b-8ed4-4d97-9b2d-d40093d0715e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-e0c4b73b-8ed4-4d97-9b2d-d40093d0715e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:11.032810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:11.033695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:11.034458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 232/484] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:11.049987 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4b73b-8ed4-4d97-9b2d-d40093d0715e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:11.053289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-60a48707-0e35-4ce8-a2c6-c5e497e3e071 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:11.054673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-60a48707-0e35-4ce8-a2c6-c5e497e3e071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:11.164226 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 253/485] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:11.213477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a48707-0e35-4ce8-a2c6-c5e497e3e071 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:11.222113 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4b73b-8ed4-4d97-9b2d-d40093d0715e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:11.281831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51c91e-3e57-4f57-97c5-dcfdb0390697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:11.282894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51c91e-3e57-4f57-97c5-dcfdb0390697 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.283369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51c91e-3e57-4f57-97c5-dcfdb0390697 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.283832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51c91e-3e57-4f57-97c5-dcfdb0390697 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.284790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51c91e-3e57-4f57-97c5-dcfdb0390697 None admin] RBAC: Adding query filter params (name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:11.285305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51c91e-3e57-4f57-97c5-dcfdb0390697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:11.292208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51c91e-3e57-4f57-97c5-dcfdb0390697 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:11.307618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 233/486] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:11.314038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51c91e-3e57-4f57-97c5-dcfdb0390697 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:11.322524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a48707-0e35-4ce8-a2c6-c5e497e3e071 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:11.356366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bd247-8f18-4dda-835c-677cef2ac133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:11.357158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bd247-8f18-4dda-835c-677cef2ac133 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.357435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bd247-8f18-4dda-835c-677cef2ac133 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.357705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bd247-8f18-4dda-835c-677cef2ac133 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.368742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bd247-8f18-4dda-835c-677cef2ac133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-b59bd247-8f18-4dda-835c-677cef2ac133 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:11.377017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:11.377888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:11.378663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 254/487] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:11.384250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bd247-8f18-4dda-835c-677cef2ac133 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:11.459674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51c91e-3e57-4f57-97c5-dcfdb0390697 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:11.489944 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bd247-8f18-4dda-835c-677cef2ac133 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:11.495105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8bcb5-c215-4ab4-b795-e3152e475494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:11.496132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8bcb5-c215-4ab4-b795-e3152e475494 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.496609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8bcb5-c215-4ab4-b795-e3152e475494 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.497112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8bcb5-c215-4ab4-b795-e3152e475494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.509970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8bcb5-c215-4ab4-b795-e3152e475494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:11.512569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8bcb5-c215-4ab4-b795-e3152e475494 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:11.529358 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6b94-5e82-4cc8-adeb-f218f7aa3a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:11.530227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6b94-5e82-4cc8-adeb-f218f7aa3a62 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.531136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6b94-5e82-4cc8-adeb-f218f7aa3a62 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.534162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6b94-5e82-4cc8-adeb-f218f7aa3a62 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.534162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6b94-5e82-4cc8-adeb-f218f7aa3a62 None admin] RBAC: Adding query filter params (name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:11.534162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6b94-5e82-4cc8-adeb-f218f7aa3a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:11.534162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6b94-5e82-4cc8-adeb-f218f7aa3a62 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-07d8bcb5-c215-4ab4-b795-e3152e475494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:11.543126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:11.543961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:11.544806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:11.544806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:11.544806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:11.544806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:11.545015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 255/488] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:11.545015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d801e1-80c7-41e6-83b2-448834b52946 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.545739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d801e1-80c7-41e6-83b2-448834b52946 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.546085 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d801e1-80c7-41e6-83b2-448834b52946 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.552200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 256/490] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:11.552200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d801e1-80c7-41e6-83b2-448834b52946 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:11.552386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 234/490] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:11.553695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d299eb-0abf-45a3-a35b-6ee4f4f29b41 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.553983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d299eb-0abf-45a3-a35b-6ee4f4f29b41 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.554257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d299eb-0abf-45a3-a35b-6ee4f4f29b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.574893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-04d299eb-0abf-45a3-a35b-6ee4f4f29b41 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:11.575986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-04d299eb-0abf-45a3-a35b-6ee4f4f29b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:11.658512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 235/491] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:11.659831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d299eb-0abf-45a3-a35b-6ee4f4f29b41 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:11.677655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d801e1-80c7-41e6-83b2-448834b52946 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:11.714744 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08f5f2-05ea-4dad-812c-8b60264b8673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:11.716914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08f5f2-05ea-4dad-812c-8b60264b8673 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.717535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08f5f2-05ea-4dad-812c-8b60264b8673 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.718549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08f5f2-05ea-4dad-812c-8b60264b8673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.730510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08f5f2-05ea-4dad-812c-8b60264b8673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:11.732355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08f5f2-05ea-4dad-812c-8b60264b8673 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-8f08f5f2-05ea-4dad-812c-8b60264b8673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:11.750823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:11.751692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:11.752531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:11.752531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:11.752531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:11.752531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:11.754767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 257/492] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:11.755745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08f5f2-05ea-4dad-812c-8b60264b8673 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:11.776579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d299eb-0abf-45a3-a35b-6ee4f4f29b41 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:11.819888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971a37-eaa6-477d-ba0c-de7a2470124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:11.820828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971a37-eaa6-477d-ba0c-de7a2470124f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.821211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971a37-eaa6-477d-ba0c-de7a2470124f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.821489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f971a37-eaa6-477d-ba0c-de7a2470124f None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.822210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f971a37-eaa6-477d-ba0c-de7a2470124f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:11.822516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f971a37-eaa6-477d-ba0c-de7a2470124f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:11.823890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f971a37-eaa6-477d-ba0c-de7a2470124f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:11.842975 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 236/493] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:11.842975 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971a37-eaa6-477d-ba0c-de7a2470124f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:11.862840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08f5f2-05ea-4dad-812c-8b60264b8673 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:11.896079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8acf8-dfef-4b94-b000-ef14c37c666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:11.896922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8acf8-dfef-4b94-b000-ef14c37c666e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.897207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8acf8-dfef-4b94-b000-ef14c37c666e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.897481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8acf8-dfef-4b94-b000-ef14c37c666e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.909600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8acf8-dfef-4b94-b000-ef14c37c666e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-62c8acf8-dfef-4b94-b000-ef14c37c666e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:11.918013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:11.919112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:11.920067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:11.922264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 258/494] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:11.923260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8acf8-dfef-4b94-b000-ef14c37c666e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:11.953646 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f971a37-eaa6-477d-ba0c-de7a2470124f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:11.987408 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9027f-f052-41a4-9e0e-821039f091f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:11.988081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9027f-f052-41a4-9e0e-821039f091f2 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:11.988396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9027f-f052-41a4-9e0e-821039f091f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:11.988673 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9027f-f052-41a4-9e0e-821039f091f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:11.989401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9027f-f052-41a4-9e0e-821039f091f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:11.989713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9027f-f052-41a4-9e0e-821039f091f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:11.991099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9027f-f052-41a4-9e0e-821039f091f2 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:12.002995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 237/495] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:12.004393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0b480-867e-4b9a-b2a9-77a1d9e848f8 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.004595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0b480-867e-4b9a-b2a9-77a1d9e848f8 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.004871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0b480-867e-4b9a-b2a9-77a1d9e848f8 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.006211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 238/496] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:12.010723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0b480-867e-4b9a-b2a9-77a1d9e848f8 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:12.024699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8acf8-dfef-4b94-b000-ef14c37c666e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:12.057398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3247d20-247c-40ba-ade1-28b53e3930c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:12.058180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3247d20-247c-40ba-ade1-28b53e3930c2 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.058460 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3247d20-247c-40ba-ade1-28b53e3930c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.058736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3247d20-247c-40ba-ade1-28b53e3930c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.066688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3247d20-247c-40ba-ade1-28b53e3930c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:12.068163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3247d20-247c-40ba-ade1-28b53e3930c2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-a3247d20-247c-40ba-ade1-28b53e3930c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:12.083574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:12.084764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 259/497] 10.222.0.58 () {56 vars in 1093 bytes} [Tue May 17 11:53:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:12.090426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3247d20-247c-40ba-ade1-28b53e3930c2 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:12.116894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0b480-867e-4b9a-b2a9-77a1d9e848f8 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:12.149092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89c067-f9a9-4815-abc8-c49932da37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:12.149760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89c067-f9a9-4815-abc8-c49932da37ca None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.150044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89c067-f9a9-4815-abc8-c49932da37ca None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.150322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89c067-f9a9-4815-abc8-c49932da37ca None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.151066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89c067-f9a9-4815-abc8-c49932da37ca None admin] RBAC: Adding query filter params (name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:12.151376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89c067-f9a9-4815-abc8-c49932da37ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:12.152797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89c067-f9a9-4815-abc8-c49932da37ca None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:12.161396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 239/498] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:12.162584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e65747-db8f-4bc8-812d-0f7f165345a9 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.162873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e65747-db8f-4bc8-812d-0f7f165345a9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.163153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e65747-db8f-4bc8-812d-0f7f165345a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.180070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3247d20-247c-40ba-ade1-28b53e3930c2 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:12.180670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f5e65747-db8f-4bc8-812d-0f7f165345a9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:12.181851 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f5e65747-db8f-4bc8-812d-0f7f165345a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:12.212002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95459d00-eb96-4745-b77c-cd1357ce0b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:12.212806 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95459d00-eb96-4745-b77c-cd1357ce0b69 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.213095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95459d00-eb96-4745-b77c-cd1357ce0b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.213369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95459d00-eb96-4745-b77c-cd1357ce0b69 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.221530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95459d00-eb96-4745-b77c-cd1357ce0b69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:12.222974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95459d00-eb96-4745-b77c-cd1357ce0b69 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-95459d00-eb96-4745-b77c-cd1357ce0b69 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:12.236769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:12.237643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:12.238528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:12.238528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:12.238528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:12.238528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:12.238528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:12.238528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:12.238528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:12.238528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:12.238528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 11:53:12.238528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:12.238528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 260/499] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:12.239064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95459d00-eb96-4745-b77c-cd1357ce0b69 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:12.248986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 240/500] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:12.250544 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3033f52-d9c3-4d2a-80d6-3c6beaa612e0 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.250837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3033f52-d9c3-4d2a-80d6-3c6beaa612e0 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.251114 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3033f52-d9c3-4d2a-80d6-3c6beaa612e0 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.256340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 241/501] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:12.256340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3033f52-d9c3-4d2a-80d6-3c6beaa612e0 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:12.337017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95459d00-eb96-4745-b77c-cd1357ce0b69 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:12.354794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3033f52-d9c3-4d2a-80d6-3c6beaa612e0 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:12.368138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2b6ff-e87f-43a9-a20b-b7f62e13f1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:12.368780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2b6ff-e87f-43a9-a20b-b7f62e13f1d5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.369066 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2b6ff-e87f-43a9-a20b-b7f62e13f1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.369342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2b6ff-e87f-43a9-a20b-b7f62e13f1d5 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.370173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2b6ff-e87f-43a9-a20b-b7f62e13f1d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:12.370484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2b6ff-e87f-43a9-a20b-b7f62e13f1d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:12.371916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2b6ff-e87f-43a9-a20b-b7f62e13f1d5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:12.386870 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ebae8-9081-4401-a456-fdb7ab5beafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:12.387661 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ebae8-9081-4401-a456-fdb7ab5beafe None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.387947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ebae8-9081-4401-a456-fdb7ab5beafe None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.388249 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ebae8-9081-4401-a456-fdb7ab5beafe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.398539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ebae8-9081-4401-a456-fdb7ab5beafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:12.399968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ebae8-9081-4401-a456-fdb7ab5beafe None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:12.408433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 261/502] 10.222.0.58 () {56 vars in 1133 bytes} [Tue May 17 11:53:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:12.409250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2b6ff-e87f-43a9-a20b-b7f62e13f1d5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-fa1ebae8-9081-4401-a456-fdb7ab5beafe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:12.422888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:12.423903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:12.429268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:12.429268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:12.429268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:12.429268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:12.429268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 242/503] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:12.429268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c9aca-7ce8-4be3-9075-6c443f21f297 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.429268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c9aca-7ce8-4be3-9075-6c443f21f297 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.429268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c9aca-7ce8-4be3-9075-6c443f21f297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.441709 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-501c9aca-7ce8-4be3-9075-6c443f21f297 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:12.442874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-501c9aca-7ce8-4be3-9075-6c443f21f297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:12.505508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 243/504] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:12.506331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c9aca-7ce8-4be3-9075-6c443f21f297 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:12.508807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2b6ff-e87f-43a9-a20b-b7f62e13f1d5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:12.544683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94506b-7085-4401-b487-f40d7dd5d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:12.545351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94506b-7085-4401-b487-f40d7dd5d90d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.545634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94506b-7085-4401-b487-f40d7dd5d90d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.545906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94506b-7085-4401-b487-f40d7dd5d90d None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.547869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94506b-7085-4401-b487-f40d7dd5d90d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:12.548220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94506b-7085-4401-b487-f40d7dd5d90d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:12.549733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94506b-7085-4401-b487-f40d7dd5d90d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:12.566521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 262/505] 10.222.0.58 () {56 vars in 1137 bytes} [Tue May 17 11:53:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:12.567317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94506b-7085-4401-b487-f40d7dd5d90d None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:12.603297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c9aca-7ce8-4be3-9075-6c443f21f297 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:12.634782 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479f494-aaa9-43e8-8ac3-42669e35f497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:12.635505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479f494-aaa9-43e8-8ac3-42669e35f497 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.635785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479f494-aaa9-43e8-8ac3-42669e35f497 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.636054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479f494-aaa9-43e8-8ac3-42669e35f497 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.646279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479f494-aaa9-43e8-8ac3-42669e35f497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-7479f494-aaa9-43e8-8ac3-42669e35f497 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:12.653961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:12.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:12.655868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 244/506] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:12.656554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479f494-aaa9-43e8-8ac3-42669e35f497 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:12.663699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94506b-7085-4401-b487-f40d7dd5d90d None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:12.696525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec614a-7472-4100-a019-999c7a94c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:12.697163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec614a-7472-4100-a019-999c7a94c388 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.697448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec614a-7472-4100-a019-999c7a94c388 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.697724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec614a-7472-4100-a019-999c7a94c388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.750037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479f494-aaa9-43e8-8ac3-42669e35f497 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:12.762101 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec614a-7472-4100-a019-999c7a94c388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:12.763572 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec614a-7472-4100-a019-999c7a94c388 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:12.782448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4c2ad-b93b-4ca4-9449-5e4f3e017e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:12.783108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4c2ad-b93b-4ca4-9449-5e4f3e017e1a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.783388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4c2ad-b93b-4ca4-9449-5e4f3e017e1a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.783663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4c2ad-b93b-4ca4-9449-5e4f3e017e1a None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.784431 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4c2ad-b93b-4ca4-9449-5e4f3e017e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:12.784739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4c2ad-b93b-4ca4-9449-5e4f3e017e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:12.786104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4c2ad-b93b-4ca4-9449-5e4f3e017e1a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:12.797430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 245/507] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:12.798224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4c2ad-b93b-4ca4-9449-5e4f3e017e1a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:12.858042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 263/508] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:12.858938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec614a-7472-4100-a019-999c7a94c388 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:12.892503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4c2ad-b93b-4ca4-9449-5e4f3e017e1a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:12.924074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb62b9-aa0e-4f9c-a023-f249a6829917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:12.924974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb62b9-aa0e-4f9c-a023-f249a6829917 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.925253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb62b9-aa0e-4f9c-a023-f249a6829917 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.925526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb62b9-aa0e-4f9c-a023-f249a6829917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:12.935417 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb62b9-aa0e-4f9c-a023-f249a6829917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:12.936905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb62b9-aa0e-4f9c-a023-f249a6829917 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:12.951919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec614a-7472-4100-a019-999c7a94c388 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-f0fb62b9-aa0e-4f9c-a023-f249a6829917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:12.954405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:12.955197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:12.956003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:12.956003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:12.956003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:12.956003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:12.960257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 246/509] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:12.961083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb62b9-aa0e-4f9c-a023-f249a6829917 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:12.985928 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa65a4-e008-4f25-94f3-9d23bb9cb9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:12.986685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa65a4-e008-4f25-94f3-9d23bb9cb9fd None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:12.987040 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa65a4-e008-4f25-94f3-9d23bb9cb9fd None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:12.987391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa65a4-e008-4f25-94f3-9d23bb9cb9fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.051137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa65a4-e008-4f25-94f3-9d23bb9cb9fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.052742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa65a4-e008-4f25-94f3-9d23bb9cb9fd None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.053753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb62b9-aa0e-4f9c-a023-f249a6829917 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:13.085616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b273a6-66c0-467b-998e-f02eb01afa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:13.086262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b273a6-66c0-467b-998e-f02eb01afa7d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:13.086541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b273a6-66c0-467b-998e-f02eb01afa7d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:13.086809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b273a6-66c0-467b-998e-f02eb01afa7d None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.087536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b273a6-66c0-467b-998e-f02eb01afa7d None admin] RBAC: Adding query filter params (name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:13.087845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b273a6-66c0-467b-998e-f02eb01afa7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.089219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b273a6-66c0-467b-998e-f02eb01afa7d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.097285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 247/510] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:13.098055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b273a6-66c0-467b-998e-f02eb01afa7d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.148994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 264/511] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:13.149754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa65a4-e008-4f25-94f3-9d23bb9cb9fd None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.196103 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b273a6-66c0-467b-998e-f02eb01afa7d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:13.228773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ab550-2bdb-4942-867a-603e17f5e838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:13.229560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ab550-2bdb-4942-867a-603e17f5e838 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:13.229838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ab550-2bdb-4942-867a-603e17f5e838 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:13.230108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ab550-2bdb-4942-867a-603e17f5e838 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.237651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ab550-2bdb-4942-867a-603e17f5e838 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.239084 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ab550-2bdb-4942-867a-603e17f5e838 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.241717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa65a4-e008-4f25-94f3-9d23bb9cb9fd None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-120ab550-2bdb-4942-867a-603e17f5e838 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:13.254670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:13.255531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:13.256657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:13.256657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:13.256657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:13.256657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:13.256657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:13.256657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:13.256657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:13.256657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:13.256657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 11:53:13.256657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:13.256657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 248/512] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:13.257749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ab550-2bdb-4942-867a-603e17f5e838 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.278666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63fb5b-f426-40f4-8e3c-3a5cf972128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:13.279443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63fb5b-f426-40f4-8e3c-3a5cf972128f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:13.279719 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63fb5b-f426-40f4-8e3c-3a5cf972128f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:13.279986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63fb5b-f426-40f4-8e3c-3a5cf972128f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.289551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63fb5b-f426-40f4-8e3c-3a5cf972128f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.290985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63fb5b-f426-40f4-8e3c-3a5cf972128f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-5d63fb5b-f426-40f4-8e3c-3a5cf972128f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:13.307663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:13.308672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:13.315169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:13.315169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:13.315169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:13.315169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:13.315169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 265/513] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:13.315169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63fb5b-f426-40f4-8e3c-3a5cf972128f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.352486 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ab550-2bdb-4942-867a-603e17f5e838 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:13.384286 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2b7e3-61cb-4d63-ae55-05d3e90c9550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:13.384944 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2b7e3-61cb-4d63-ae55-05d3e90c9550 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:13.385230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2b7e3-61cb-4d63-ae55-05d3e90c9550 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:13.385511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2b7e3-61cb-4d63-ae55-05d3e90c9550 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.386228 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2b7e3-61cb-4d63-ae55-05d3e90c9550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:13.386538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2b7e3-61cb-4d63-ae55-05d3e90c9550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.387919 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2b7e3-61cb-4d63-ae55-05d3e90c9550 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.399333 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 249/514] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:13.400057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2b7e3-61cb-4d63-ae55-05d3e90c9550 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.406609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63fb5b-f426-40f4-8e3c-3a5cf972128f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:13.438700 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98abd1-2e8a-44fb-ba10-c23561a95b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:13.439484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98abd1-2e8a-44fb-ba10-c23561a95b72 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:13.439768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98abd1-2e8a-44fb-ba10-c23561a95b72 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:13.440041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98abd1-2e8a-44fb-ba10-c23561a95b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.450025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98abd1-2e8a-44fb-ba10-c23561a95b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.451467 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98abd1-2e8a-44fb-ba10-c23561a95b72 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-0b98abd1-2e8a-44fb-ba10-c23561a95b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:13.468796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:13.469789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:13.470783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:13.470783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:13.470783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:13.470783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:13.470783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 266/515] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:13.470783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98abd1-2e8a-44fb-ba10-c23561a95b72 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.494865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2b7e3-61cb-4d63-ae55-05d3e90c9550 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:13.529177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a274b-be0f-4997-b0ef-9c81866dd1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:13.530030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a274b-be0f-4997-b0ef-9c81866dd1e6 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:13.530375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a274b-be0f-4997-b0ef-9c81866dd1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:13.531468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a274b-be0f-4997-b0ef-9c81866dd1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.541657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a274b-be0f-4997-b0ef-9c81866dd1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.543096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a274b-be0f-4997-b0ef-9c81866dd1e6 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-248a274b-be0f-4997-b0ef-9c81866dd1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:13.559974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:13.561129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:13.562055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:13.562055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:13.562055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:13.562055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:13.562055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 250/516] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:13.562352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a274b-be0f-4997-b0ef-9c81866dd1e6 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.566754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98abd1-2e8a-44fb-ba10-c23561a95b72 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:13.599063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35897192-c8cf-4c89-9c45-6e656b5aaba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:13.599727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897192-c8cf-4c89-9c45-6e656b5aaba8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:13.600010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897192-c8cf-4c89-9c45-6e656b5aaba8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:13.600321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897192-c8cf-4c89-9c45-6e656b5aaba8 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.601148 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35897192-c8cf-4c89-9c45-6e656b5aaba8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:13.601457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35897192-c8cf-4c89-9c45-6e656b5aaba8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.602887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35897192-c8cf-4c89-9c45-6e656b5aaba8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.618974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 267/517] 10.222.0.58 () {56 vars in 1137 bytes} [Tue May 17 11:53:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:13.619769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35897192-c8cf-4c89-9c45-6e656b5aaba8 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.662653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a274b-be0f-4997-b0ef-9c81866dd1e6 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:13.694335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3bd0e-cadf-4f38-ad50-3c86117c2e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:13.694987 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3bd0e-cadf-4f38-ad50-3c86117c2e9f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:13.695268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3bd0e-cadf-4f38-ad50-3c86117c2e9f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:13.695541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3bd0e-cadf-4f38-ad50-3c86117c2e9f None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.696285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3bd0e-cadf-4f38-ad50-3c86117c2e9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:13.696595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3bd0e-cadf-4f38-ad50-3c86117c2e9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.697955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3bd0e-cadf-4f38-ad50-3c86117c2e9f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.709529 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 251/518] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:13.710319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3bd0e-cadf-4f38-ad50-3c86117c2e9f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.711637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35897192-c8cf-4c89-9c45-6e656b5aaba8 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:13.744333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e5ebd-eb1a-41a4-bd73-0d1b131bf46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:13.745137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5ebd-eb1a-41a4-bd73-0d1b131bf46f None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:13.745424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5ebd-eb1a-41a4-bd73-0d1b131bf46f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:13.745742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e5ebd-eb1a-41a4-bd73-0d1b131bf46f None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.746425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e5ebd-eb1a-41a4-bd73-0d1b131bf46f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.747868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e5ebd-eb1a-41a4-bd73-0d1b131bf46f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.766220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 268/519] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:53:13 2022] POST /identity/v3/users => generated 247 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:53:13.767020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e5ebd-eb1a-41a4-bd73-0d1b131bf46f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.809736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3bd0e-cadf-4f38-ad50-3c86117c2e9f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:13.847692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40286fdd-bf44-4066-9a57-33616bfc1514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:13.848528 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286fdd-bf44-4066-9a57-33616bfc1514 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:13.848880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286fdd-bf44-4066-9a57-33616bfc1514 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:13.849231 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40286fdd-bf44-4066-9a57-33616bfc1514 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.850080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40286fdd-bf44-4066-9a57-33616bfc1514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:13.850455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40286fdd-bf44-4066-9a57-33616bfc1514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.851931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40286fdd-bf44-4066-9a57-33616bfc1514 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.869524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 252/520] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:13.870516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40286fdd-bf44-4066-9a57-33616bfc1514 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.873461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e5ebd-eb1a-41a4-bd73-0d1b131bf46f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:13.909093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b1111-9ea4-442c-9f08-a0c46d2d3c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:13.909773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b1111-9ea4-442c-9f08-a0c46d2d3c92 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:13.910054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b1111-9ea4-442c-9f08-a0c46d2d3c92 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:13.910327 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b1111-9ea4-442c-9f08-a0c46d2d3c92 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:13.911062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b1111-9ea4-442c-9f08-a0c46d2d3c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:13.911370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b1111-9ea4-442c-9f08-a0c46d2d3c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:13.912884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b1111-9ea4-442c-9f08-a0c46d2d3c92 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:13.925703 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 269/521] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:13.926576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b1111-9ea4-442c-9f08-a0c46d2d3c92 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:13.980656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40286fdd-bf44-4066-9a57-33616bfc1514 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:14.017596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1abd46-65ef-487c-a750-3e1811717b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:14.018250 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1abd46-65ef-487c-a750-3e1811717b94 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:14.018530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1abd46-65ef-487c-a750-3e1811717b94 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:14.018804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1abd46-65ef-487c-a750-3e1811717b94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:14.032442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b1111-9ea4-442c-9f08-a0c46d2d3c92 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:14.067036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9a47-1d7e-44dd-a1ee-272076147ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:14.067837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9a47-1d7e-44dd-a1ee-272076147ca2 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:14.068125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9a47-1d7e-44dd-a1ee-272076147ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:14.068431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d9a47-1d7e-44dd-a1ee-272076147ca2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:14.075187 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d9a47-1d7e-44dd-a1ee-272076147ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:14.076681 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d9a47-1d7e-44dd-a1ee-272076147ca2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:14.085740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1abd46-65ef-487c-a750-3e1811717b94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:14.087258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1abd46-65ef-487c-a750-3e1811717b94 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-448d9a47-1d7e-44dd-a1ee-272076147ca2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:14.091487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:14.092502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:14.094026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:14.094026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:14.094026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:14.094026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:14.094026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:14.094026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:14.094026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:14.094026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:14.094791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 270/522] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:14.095777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9a47-1d7e-44dd-a1ee-272076147ca2 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:14.184920 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 253/523] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:14.186316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1abd46-65ef-487c-a750-3e1811717b94 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:14.194332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d9a47-1d7e-44dd-a1ee-272076147ca2 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:14.227315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb953c9-3ed3-4d9f-b5c6-623ca26198e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:14.228114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb953c9-3ed3-4d9f-b5c6-623ca26198e2 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:14.228430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb953c9-3ed3-4d9f-b5c6-623ca26198e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:14.228708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb953c9-3ed3-4d9f-b5c6-623ca26198e2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:14.236990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb953c9-3ed3-4d9f-b5c6-623ca26198e2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:14.238495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb953c9-3ed3-4d9f-b5c6-623ca26198e2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-6bb953c9-3ed3-4d9f-b5c6-623ca26198e2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:14.253076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:14.254130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:14.255017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:14.255017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:14.255017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:14.255017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:14.255017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:14.255017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:14.255017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:14.255017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:14.255017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 11:53:14.255017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:14.255017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 271/524] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:14.255572 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb953c9-3ed3-4d9f-b5c6-623ca26198e2 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:14.288745 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1abd46-65ef-487c-a750-3e1811717b94 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:14.325348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d6faa-fc7d-4229-b55c-cde103f7899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:14.326134 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6faa-fc7d-4229-b55c-cde103f7899a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:14.326412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6faa-fc7d-4229-b55c-cde103f7899a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:14.326681 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6faa-fc7d-4229-b55c-cde103f7899a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:14.333500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d6faa-fc7d-4229-b55c-cde103f7899a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:14.334924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d6faa-fc7d-4229-b55c-cde103f7899a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-050d6faa-fc7d-4229-b55c-cde103f7899a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:14.349371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:14.350339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:14.351364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:14.351364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:14.351364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:14.351364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:14.351364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:14.351364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:14.351364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:14.351364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:14.353173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb953c9-3ed3-4d9f-b5c6-623ca26198e2 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:14.355252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 254/525] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:14.355858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d6faa-fc7d-4229-b55c-cde103f7899a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:14.388362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b3a75-9f5a-4c97-ba4a-152700753e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:14.389115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b3a75-9f5a-4c97-ba4a-152700753e50 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:14.389473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b3a75-9f5a-4c97-ba4a-152700753e50 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:14.390448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b3a75-9f5a-4c97-ba4a-152700753e50 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:14.391525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b3a75-9f5a-4c97-ba4a-152700753e50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:14.391839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b3a75-9f5a-4c97-ba4a-152700753e50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:14.393340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b3a75-9f5a-4c97-ba4a-152700753e50 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:14.415678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 272/526] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:14.415678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b3a75-9f5a-4c97-ba4a-152700753e50 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:14.459834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d6faa-fc7d-4229-b55c-cde103f7899a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:14.492058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79670c-6959-4eeb-84c2-965499f161f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:14.492872 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79670c-6959-4eeb-84c2-965499f161f4 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:14.493154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79670c-6959-4eeb-84c2-965499f161f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:14.493428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79670c-6959-4eeb-84c2-965499f161f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:14.503682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79670c-6959-4eeb-84c2-965499f161f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:14.505157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79670c-6959-4eeb-84c2-965499f161f4 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:14.510383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b3a75-9f5a-4c97-ba4a-152700753e50 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-fa79670c-6959-4eeb-84c2-965499f161f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:14.522543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:14.523369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:14.524644 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:14.524644 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:14.524644 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:14.524644 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:14.528211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 255/527] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:14.528932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79670c-6959-4eeb-84c2-965499f161f4 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:14.551026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6dc35-7c1f-450f-8f53-82d24a92dd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:14.551699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6dc35-7c1f-450f-8f53-82d24a92dd0f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:14.551983 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6dc35-7c1f-450f-8f53-82d24a92dd0f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:14.552288 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6dc35-7c1f-450f-8f53-82d24a92dd0f None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:14.553128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6dc35-7c1f-450f-8f53-82d24a92dd0f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:14.553445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6dc35-7c1f-450f-8f53-82d24a92dd0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:14.554896 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6dc35-7c1f-450f-8f53-82d24a92dd0f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:14.573687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 273/528] 10.222.0.58 () {56 vars in 1139 bytes} [Tue May 17 11:53:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:14.574510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6dc35-7c1f-450f-8f53-82d24a92dd0f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:14.635403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79670c-6959-4eeb-84c2-965499f161f4 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:14.669137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e712a08-8ac8-4a41-acaa-a216862dddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:14.669839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6dc35-7c1f-450f-8f53-82d24a92dd0f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:14.670362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712a08-8ac8-4a41-acaa-a216862dddb1 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:14.670859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712a08-8ac8-4a41-acaa-a216862dddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:14.671523 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e712a08-8ac8-4a41-acaa-a216862dddb1 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:14.672714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e712a08-8ac8-4a41-acaa-a216862dddb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:14.673244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e712a08-8ac8-4a41-acaa-a216862dddb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:14.674861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e712a08-8ac8-4a41-acaa-a216862dddb1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:14.694412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 256/529] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:14.695579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e712a08-8ac8-4a41-acaa-a216862dddb1 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:14.707506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cda8e-629b-4da1-99ae-cfd89a2b0a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:14.708161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cda8e-629b-4da1-99ae-cfd89a2b0a13 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:14.708462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cda8e-629b-4da1-99ae-cfd89a2b0a13 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:14.708734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cda8e-629b-4da1-99ae-cfd89a2b0a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:14.709564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cda8e-629b-4da1-99ae-cfd89a2b0a13 None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=d86479ff40f54e7793f1771cb6ad362a) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:14.709924 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cda8e-629b-4da1-99ae-cfd89a2b0a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:14.711296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cda8e-629b-4da1-99ae-cfd89a2b0a13 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:14.724650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 274/530] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:14 2022] GET /identity/v3/role_assignments?user.id=d86479ff40f54e7793f1771cb6ad362a&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:14.724650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cda8e-629b-4da1-99ae-cfd89a2b0a13 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:14.801847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e712a08-8ac8-4a41-acaa-a216862dddb1 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:14.836570 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cda8e-629b-4da1-99ae-cfd89a2b0a13 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:14.839647 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a25b02-809a-4b54-9324-ff42f1b08abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:14.840468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25b02-809a-4b54-9324-ff42f1b08abd None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:14.840862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25b02-809a-4b54-9324-ff42f1b08abd None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:14.841238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25b02-809a-4b54-9324-ff42f1b08abd None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:14.842081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a25b02-809a-4b54-9324-ff42f1b08abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:14.842494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a25b02-809a-4b54-9324-ff42f1b08abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:14.844954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a25b02-809a-4b54-9324-ff42f1b08abd None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:14.857813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 257/531] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:14.860277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a25b02-809a-4b54-9324-ff42f1b08abd None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:14.876268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79efb1-13ab-4d72-adb5-bd2c2493fd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:14.877282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79efb1-13ab-4d72-adb5-bd2c2493fd10 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:14.877282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79efb1-13ab-4d72-adb5-bd2c2493fd10 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:14.877479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79efb1-13ab-4d72-adb5-bd2c2493fd10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:14.952129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79efb1-13ab-4d72-adb5-bd2c2493fd10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:14.954151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79efb1-13ab-4d72-adb5-bd2c2493fd10 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:14.978837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a25b02-809a-4b54-9324-ff42f1b08abd None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:15.013536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f3e5c-d675-402b-b782-92ceaf60a317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:15.014420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f3e5c-d675-402b-b782-92ceaf60a317 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:15.015340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f3e5c-d675-402b-b782-92ceaf60a317 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:15.015785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f3e5c-d675-402b-b782-92ceaf60a317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:15.016794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f3e5c-d675-402b-b782-92ceaf60a317 None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=767fe573dff349918c26995c206f2155) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:15.017242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f3e5c-d675-402b-b782-92ceaf60a317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:15.018811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f3e5c-d675-402b-b782-92ceaf60a317 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:15.028452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 258/532] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:14 2022] GET /identity/v3/role_assignments?user.id=767fe573dff349918c26995c206f2155&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:15.029686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f3e5c-d675-402b-b782-92ceaf60a317 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:15.069888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 275/533] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:15.075510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79efb1-13ab-4d72-adb5-bd2c2493fd10 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:15.187657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f3e5c-d675-402b-b782-92ceaf60a317 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:15.219984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79efb1-13ab-4d72-adb5-bd2c2493fd10 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:15.222706 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d85e9e-ff20-450c-b282-3fc4b0a063b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:15.223628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85e9e-ff20-450c-b282-3fc4b0a063b0 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:15.224012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85e9e-ff20-450c-b282-3fc4b0a063b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:15.224415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d85e9e-ff20-450c-b282-3fc4b0a063b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:15.232422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d85e9e-ff20-450c-b282-3fc4b0a063b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:15.234545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d85e9e-ff20-450c-b282-3fc4b0a063b0 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-08d85e9e-ff20-450c-b282-3fc4b0a063b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:15.258096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:15.259153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:15.260271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:15.260271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:15.260271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:15.260271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:15.260271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:15.260271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:15.260271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:15.260271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:15.262000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 259/534] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:15.262535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c1e6-72e3-4730-9946-a8a5d11f02fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:15.263463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c1e6-72e3-4730-9946-a8a5d11f02fa None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:15.263865 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c1e6-72e3-4730-9946-a8a5d11f02fa None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:15.264299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c1e6-72e3-4730-9946-a8a5d11f02fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:15.272334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d85e9e-ff20-450c-b282-3fc4b0a063b0 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:15.289280 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260c1e6-72e3-4730-9946-a8a5d11f02fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:15.291198 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260c1e6-72e3-4730-9946-a8a5d11f02fa None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-7260c1e6-72e3-4730-9946-a8a5d11f02fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:15.314901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:15.315926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:15.316959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:15.316959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:15.316959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:15.316959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:15.318206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 276/535] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:15.323595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c1e6-72e3-4730-9946-a8a5d11f02fa None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:15.434680 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d85e9e-ff20-450c-b282-3fc4b0a063b0 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:15.484068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c1e6-72e3-4730-9946-a8a5d11f02fa None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:15.524888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650308c2-9c95-4087-b8b2-d1db5bd5a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:15.525765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32106833-94af-4b4f-adb3-2aa2f16a1645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:15.526512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650308c2-9c95-4087-b8b2-d1db5bd5a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:15.527273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106833-94af-4b4f-adb3-2aa2f16a1645 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:15.527653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650308c2-9c95-4087-b8b2-d1db5bd5a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:15.528020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650308c2-9c95-4087-b8b2-d1db5bd5a6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:15.528401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106833-94af-4b4f-adb3-2aa2f16a1645 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:15.529471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650308c2-9c95-4087-b8b2-d1db5bd5a6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:15.529799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32106833-94af-4b4f-adb3-2aa2f16a1645 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:15.531279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32106833-94af-4b4f-adb3-2aa2f16a1645 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:15.531587 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650308c2-9c95-4087-b8b2-d1db5bd5a6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:15.533124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650308c2-9c95-4087-b8b2-d1db5bd5a6f5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:15.533532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32106833-94af-4b4f-adb3-2aa2f16a1645 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:15.535045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32106833-94af-4b4f-adb3-2aa2f16a1645 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:15.552257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 277/536] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:15.555455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650308c2-9c95-4087-b8b2-d1db5bd5a6f5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:15.560009 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 260/537] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:15.566003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32106833-94af-4b4f-adb3-2aa2f16a1645 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:15.655817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650308c2-9c95-4087-b8b2-d1db5bd5a6f5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:15.698146 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3d509-8d0d-4017-aee5-44a97159f270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:15.698943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3d509-8d0d-4017-aee5-44a97159f270 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:15.699220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3d509-8d0d-4017-aee5-44a97159f270 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:15.699498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3d509-8d0d-4017-aee5-44a97159f270 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:15.713333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3d509-8d0d-4017-aee5-44a97159f270 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:15.714800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3d509-8d0d-4017-aee5-44a97159f270 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:15.738921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32106833-94af-4b4f-adb3-2aa2f16a1645 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-33c3d509-8d0d-4017-aee5-44a97159f270 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:15.750395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:15.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:15.752007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:15.752007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:15.752007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:15.752007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:15.752007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:15.752007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:15.752007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:15.752007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:15.757989 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 278/538] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:15.760901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3d509-8d0d-4017-aee5-44a97159f270 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:15.794273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940772d-901a-494a-8462-dde6b9ab11cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:15.795270 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940772d-901a-494a-8462-dde6b9ab11cf None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:15.795743 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940772d-901a-494a-8462-dde6b9ab11cf None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:15.796747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940772d-901a-494a-8462-dde6b9ab11cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:15.797807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940772d-901a-494a-8462-dde6b9ab11cf None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=1b14c0c2f0cd4459915dbbe3b5939159) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:15.798516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940772d-901a-494a-8462-dde6b9ab11cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:15.800222 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940772d-901a-494a-8462-dde6b9ab11cf None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:15.806546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 261/539] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:15 2022] GET /identity/v3/role_assignments?user.id=1b14c0c2f0cd4459915dbbe3b5939159&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:15.865444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3d509-8d0d-4017-aee5-44a97159f270 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:15.901207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38254cf6-13ad-41a6-a5c7-fad2e26b3817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:15.901866 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254cf6-13ad-41a6-a5c7-fad2e26b3817 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:15.902147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254cf6-13ad-41a6-a5c7-fad2e26b3817 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:15.902423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254cf6-13ad-41a6-a5c7-fad2e26b3817 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:15.903203 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254cf6-13ad-41a6-a5c7-fad2e26b3817 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:15.903510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254cf6-13ad-41a6-a5c7-fad2e26b3817 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:15.904974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254cf6-13ad-41a6-a5c7-fad2e26b3817 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:15.918019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 279/540] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:15.924300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940772d-901a-494a-8462-dde6b9ab11cf None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:16.032786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940772d-901a-494a-8462-dde6b9ab11cf None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:16.069007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ca776-af3c-4490-ba74-67f22b82a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:16.069677 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca776-af3c-4490-ba74-67f22b82a14b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:16.069958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca776-af3c-4490-ba74-67f22b82a14b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:16.070230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca776-af3c-4490-ba74-67f22b82a14b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:16.071074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ca776-af3c-4490-ba74-67f22b82a14b None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=95029e6140de425e86b5f9d7e2923bb0) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:16.071382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ca776-af3c-4490-ba74-67f22b82a14b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:16.072890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ca776-af3c-4490-ba74-67f22b82a14b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:16.080366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 262/541] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:15 2022] GET /identity/v3/role_assignments?user.id=95029e6140de425e86b5f9d7e2923bb0&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:16.347644 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d680d2-595b-4147-9821-78b6ca1841f4 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:16.347977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d680d2-595b-4147-9821-78b6ca1841f4 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:16.348121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d680d2-595b-4147-9821-78b6ca1841f4 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:16.349810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 280/542] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:16.355227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36137b85-08ea-46f3-a4ce-a81f36a02db8 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:16.355528 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36137b85-08ea-46f3-a4ce-a81f36a02db8 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:16.355813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36137b85-08ea-46f3-a4ce-a81f36a02db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:16.372568 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-36137b85-08ea-46f3-a4ce-a81f36a02db8 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:16.373933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-36137b85-08ea-46f3-a4ce-a81f36a02db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:16.454041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 263/543] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:16.501658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d680d2-595b-4147-9821-78b6ca1841f4 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:16.660903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d680d2-595b-4147-9821-78b6ca1841f4 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:16.712904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04438f-937a-4771-8c22-d5bf79884bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:16.713721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04438f-937a-4771-8c22-d5bf79884bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:16.714010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04438f-937a-4771-8c22-d5bf79884bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:16.714289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04438f-937a-4771-8c22-d5bf79884bc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:16.727664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04438f-937a-4771-8c22-d5bf79884bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-3d04438f-937a-4771-8c22-d5bf79884bc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:16.736336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:16.738338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:16.740240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 281/544] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:16.748204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36137b85-08ea-46f3-a4ce-a81f36a02db8 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:16.892818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36137b85-08ea-46f3-a4ce-a81f36a02db8 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:16.928283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379ce12-f1ea-448a-bbce-c71bd3d124e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:16.929037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ce12-f1ea-448a-bbce-c71bd3d124e2 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:16.929194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ce12-f1ea-448a-bbce-c71bd3d124e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:16.929408 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379ce12-f1ea-448a-bbce-c71bd3d124e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:16.930157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379ce12-f1ea-448a-bbce-c71bd3d124e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:16.930463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379ce12-f1ea-448a-bbce-c71bd3d124e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:16.931829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379ce12-f1ea-448a-bbce-c71bd3d124e2 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:16.940663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 264/545] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:16.945943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04438f-937a-4771-8c22-d5bf79884bc8 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:17.109947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04438f-937a-4771-8c22-d5bf79884bc8 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:17.155682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74517176-d362-4edc-a61b-4cc3e24f9227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:17.156592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74517176-d362-4edc-a61b-4cc3e24f9227 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:17.156876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74517176-d362-4edc-a61b-4cc3e24f9227 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:17.157150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74517176-d362-4edc-a61b-4cc3e24f9227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:17.168252 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74517176-d362-4edc-a61b-4cc3e24f9227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:17.169711 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74517176-d362-4edc-a61b-4cc3e24f9227 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-74517176-d362-4edc-a61b-4cc3e24f9227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:17.194706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:17.196693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:17.198671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:17.198671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:17.198671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:17.198671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:17.198671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 282/546] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:17.206586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379ce12-f1ea-448a-bbce-c71bd3d124e2 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:17.267469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d40bff-cadd-43d9-82a8-a0b16f2cbb7d None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:17.267789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d40bff-cadd-43d9-82a8-a0b16f2cbb7d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:17.268025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d40bff-cadd-43d9-82a8-a0b16f2cbb7d None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:17.269743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 283/547] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:53:17.274649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e96252-6125-440f-b420-9abe1f136940 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:17.274935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e96252-6125-440f-b420-9abe1f136940 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:17.275214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e96252-6125-440f-b420-9abe1f136940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:17.308971 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-e5e96252-6125-440f-b420-9abe1f136940 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:17.310428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e5e96252-6125-440f-b420-9abe1f136940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:17.399490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379ce12-f1ea-448a-bbce-c71bd3d124e2 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:17.437566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 284/548] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:53:17.462012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae47b1-4ea4-4f7d-a424-b8f547717058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:17.462614 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae47b1-4ea4-4f7d-a424-b8f547717058 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:17.462899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae47b1-4ea4-4f7d-a424-b8f547717058 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:17.463172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae47b1-4ea4-4f7d-a424-b8f547717058 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:17.463907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae47b1-4ea4-4f7d-a424-b8f547717058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:17.464238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae47b1-4ea4-4f7d-a424-b8f547717058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:17.465622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae47b1-4ea4-4f7d-a424-b8f547717058 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:17.483579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 265/549] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:17.489095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e96252-6125-440f-b420-9abe1f136940 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:17.491345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae47b1-4ea4-4f7d-a424-b8f547717058 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:17.598965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e96252-6125-440f-b420-9abe1f136940 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:17.639962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae47b1-4ea4-4f7d-a424-b8f547717058 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:17.652933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438d059-a82d-475e-a780-07d957a22084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:17.653848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438d059-a82d-475e-a780-07d957a22084 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:17.654131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438d059-a82d-475e-a780-07d957a22084 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:17.654405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438d059-a82d-475e-a780-07d957a22084 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:17.662910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438d059-a82d-475e-a780-07d957a22084 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:17.672482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438d059-a82d-475e-a780-07d957a22084 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:17.677812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4044cc-c58f-4ac3-95b2-442b6361a215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:17.678620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4044cc-c58f-4ac3-95b2-442b6361a215 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:17.678903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4044cc-c58f-4ac3-95b2-442b6361a215 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:17.679176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4044cc-c58f-4ac3-95b2-442b6361a215 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:17.691049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4044cc-c58f-4ac3-95b2-442b6361a215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-da4044cc-c58f-4ac3-95b2-442b6361a215 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:17.698979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:17.700972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:17.703015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-9438d059-a82d-475e-a780-07d957a22084 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:17.704479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:17.706351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:17.712724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:17.712724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:17.712724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:17.712724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:17.712724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:17.712724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:17.712724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:17.712724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:17.712724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:17.712724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:17.713932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 266/550] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:17.714118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 285/551] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:17.714259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4044cc-c58f-4ac3-95b2-442b6361a215 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:17.721235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438d059-a82d-475e-a780-07d957a22084 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:17.810012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4044cc-c58f-4ac3-95b2-442b6361a215 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:17.844365 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9718d7-a4bd-466b-8184-9a7d1d38b79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:17.845036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9718d7-a4bd-466b-8184-9a7d1d38b79f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:17.845319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9718d7-a4bd-466b-8184-9a7d1d38b79f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:17.845589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9718d7-a4bd-466b-8184-9a7d1d38b79f None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:17.846334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9718d7-a4bd-466b-8184-9a7d1d38b79f None admin] RBAC: Adding query filter params (name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:17.846644 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9718d7-a4bd-466b-8184-9a7d1d38b79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:17.848007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9718d7-a4bd-466b-8184-9a7d1d38b79f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:17.856450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 267/552] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:17.857764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51f1bb-feb4-4a74-8bde-c35b1ab7131e None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:17.858262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51f1bb-feb4-4a74-8bde-c35b1ab7131e None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:17.858711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51f1bb-feb4-4a74-8bde-c35b1ab7131e None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:17.860859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 268/553] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:17.862259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51f1bb-feb4-4a74-8bde-c35b1ab7131e None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:17.889008 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438d059-a82d-475e-a780-07d957a22084 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:17.924480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72da86-ee30-4549-84ff-0b13b05f92f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:17.925150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72da86-ee30-4549-84ff-0b13b05f92f3 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:17.925434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72da86-ee30-4549-84ff-0b13b05f92f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:17.925713 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72da86-ee30-4549-84ff-0b13b05f92f3 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:17.926550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72da86-ee30-4549-84ff-0b13b05f92f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:17.926863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72da86-ee30-4549-84ff-0b13b05f92f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:17.928316 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72da86-ee30-4549-84ff-0b13b05f92f3 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:17.946962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 286/554] 10.222.0.58 () {56 vars in 1135 bytes} [Tue May 17 11:53:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:17.948197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed9748-baf0-4e90-b4f5-1ec4d5da8671 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:17.948594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed9748-baf0-4e90-b4f5-1ec4d5da8671 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:17.948773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed9748-baf0-4e90-b4f5-1ec4d5da8671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:17.967248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-51ed9748-baf0-4e90-b4f5-1ec4d5da8671 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:17.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-51ed9748-baf0-4e90-b4f5-1ec4d5da8671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:17.992928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51f1bb-feb4-4a74-8bde-c35b1ab7131e None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:18.028988 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae893f-a308-4b20-80b5-8905a68c7e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:18.029829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae893f-a308-4b20-80b5-8905a68c7e14 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.030115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae893f-a308-4b20-80b5-8905a68c7e14 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.030415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae893f-a308-4b20-80b5-8905a68c7e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.042861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae893f-a308-4b20-80b5-8905a68c7e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:18.044400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae893f-a308-4b20-80b5-8905a68c7e14 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:18.048381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 287/555] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:18.050048 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed9748-baf0-4e90-b4f5-1ec4d5da8671 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-d7ae893f-a308-4b20-80b5-8905a68c7e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:18.064030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:18.065861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:18.066785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:18.066785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:18.066785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:18.066785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:18.066785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 269/556] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:18.070720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae893f-a308-4b20-80b5-8905a68c7e14 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:18.181509 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae893f-a308-4b20-80b5-8905a68c7e14 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:18.189346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed9748-baf0-4e90-b4f5-1ec4d5da8671 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:18.217449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2926ce-22ca-4970-a1fd-4f8d9d730316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:18.218545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2926ce-22ca-4970-a1fd-4f8d9d730316 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.218833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2926ce-22ca-4970-a1fd-4f8d9d730316 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.219110 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2926ce-22ca-4970-a1fd-4f8d9d730316 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.220144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2926ce-22ca-4970-a1fd-4f8d9d730316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:18.220489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2926ce-22ca-4970-a1fd-4f8d9d730316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:18.222674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2926ce-22ca-4970-a1fd-4f8d9d730316 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:18.227086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6b47f-b7bb-4fda-a18d-b188d80f822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:18.227913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b47f-b7bb-4fda-a18d-b188d80f822d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.228345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b47f-b7bb-4fda-a18d-b188d80f822d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.228732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6b47f-b7bb-4fda-a18d-b188d80f822d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.236718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 270/557] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:18.237645 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2926ce-22ca-4970-a1fd-4f8d9d730316 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:18.321057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6b47f-b7bb-4fda-a18d-b188d80f822d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:18.322824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6b47f-b7bb-4fda-a18d-b188d80f822d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:18.365940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2926ce-22ca-4970-a1fd-4f8d9d730316 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:18.408930 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697ce73-61f0-4e82-8981-aeea6123a10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:18.409737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697ce73-61f0-4e82-8981-aeea6123a10d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.410023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697ce73-61f0-4e82-8981-aeea6123a10d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.410305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697ce73-61f0-4e82-8981-aeea6123a10d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.425489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697ce73-61f0-4e82-8981-aeea6123a10d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-7697ce73-61f0-4e82-8981-aeea6123a10d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:18.433349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:18.434318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:18.435099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:18.440460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 271/558] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:18.441317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697ce73-61f0-4e82-8981-aeea6123a10d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:18.444575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 288/559] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:18.445721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6b47f-b7bb-4fda-a18d-b188d80f822d None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:18.576623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697ce73-61f0-4e82-8981-aeea6123a10d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:18.583637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6b47f-b7bb-4fda-a18d-b188d80f822d None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:18.632171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809c1de-e3bc-43cc-8191-a70cf7077e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:18.633828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809c1de-e3bc-43cc-8191-a70cf7077e97 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.634311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809c1de-e3bc-43cc-8191-a70cf7077e97 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.635083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809c1de-e3bc-43cc-8191-a70cf7077e97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.641685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f15e42-8345-4eb9-87e7-c80d8a1d5afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:18.643049 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f15e42-8345-4eb9-87e7-c80d8a1d5afc None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.643806 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f15e42-8345-4eb9-87e7-c80d8a1d5afc None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.644555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f15e42-8345-4eb9-87e7-c80d8a1d5afc None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.646121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f15e42-8345-4eb9-87e7-c80d8a1d5afc None admin] RBAC: Adding query filter params (name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:18.646926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f15e42-8345-4eb9-87e7-c80d8a1d5afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:18.648559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809c1de-e3bc-43cc-8191-a70cf7077e97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:18.649907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f15e42-8345-4eb9-87e7-c80d8a1d5afc None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:18.651018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809c1de-e3bc-43cc-8191-a70cf7077e97 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:18.664572 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 289/560] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:18.666302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f15e42-8345-4eb9-87e7-c80d8a1d5afc None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-2809c1de-e3bc-43cc-8191-a70cf7077e97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:18.689663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:18.691399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 272/561] 10.222.0.58 () {56 vars in 1093 bytes} [Tue May 17 11:53:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:18.694905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809c1de-e3bc-43cc-8191-a70cf7077e97 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:18.786780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f15e42-8345-4eb9-87e7-c80d8a1d5afc None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:18.795050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809c1de-e3bc-43cc-8191-a70cf7077e97 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:18.819861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af21a59-e943-447f-981a-55e0eb1217ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:18.820689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af21a59-e943-447f-981a-55e0eb1217ec None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.820973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af21a59-e943-447f-981a-55e0eb1217ec None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.821257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af21a59-e943-447f-981a-55e0eb1217ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.828361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648d5f2-8395-4d97-9ca8-863eb0da12a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:18.829142 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648d5f2-8395-4d97-9ca8-863eb0da12a9 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.829421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648d5f2-8395-4d97-9ca8-863eb0da12a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.829703 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648d5f2-8395-4d97-9ca8-863eb0da12a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.831685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af21a59-e943-447f-981a-55e0eb1217ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:18.833163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af21a59-e943-447f-981a-55e0eb1217ec None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:18.839664 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648d5f2-8395-4d97-9ca8-863eb0da12a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:18.841109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648d5f2-8395-4d97-9ca8-863eb0da12a9 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-8af21a59-e943-447f-981a-55e0eb1217ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:18.849771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:18.851196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:18.852416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:18.852416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:18.852416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:18.852416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:18.852416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 290/562] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:18.852416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af21a59-e943-447f-981a-55e0eb1217ec None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-8648d5f2-8395-4d97-9ca8-863eb0da12a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:18.857785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:18.859322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:18.860461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:18.860461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:18.860461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:18.860461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:18.860461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 273/563] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:18.861038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efd9c9-3521-46d7-a14a-3b454a565720 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.861321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efd9c9-3521-46d7-a14a-3b454a565720 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.861602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efd9c9-3521-46d7-a14a-3b454a565720 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.862832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 274/564] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:18.864044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55164ecb-fc1d-4abc-96d1-9c4f20a9c16c None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.864332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55164ecb-fc1d-4abc-96d1-9c4f20a9c16c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.864568 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55164ecb-fc1d-4abc-96d1-9c4f20a9c16c None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.865746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 275/565] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:18.866269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55164ecb-fc1d-4abc-96d1-9c4f20a9c16c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:18.952623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af21a59-e943-447f-981a-55e0eb1217ec None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:18.964749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55164ecb-fc1d-4abc-96d1-9c4f20a9c16c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:18.983388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7668a-35c6-4887-964d-7e437cf4f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:18.984704 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7668a-35c6-4887-964d-7e437cf4f56c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.984992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7668a-35c6-4887-964d-7e437cf4f56c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.985260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7668a-35c6-4887-964d-7e437cf4f56c None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.986085 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7668a-35c6-4887-964d-7e437cf4f56c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:18.986387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7668a-35c6-4887-964d-7e437cf4f56c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:18.987811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7668a-35c6-4887-964d-7e437cf4f56c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:18.996129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fed5b-611f-4e31-80e9-047d96985859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:18.996797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fed5b-611f-4e31-80e9-047d96985859 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:18.997074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fed5b-611f-4e31-80e9-047d96985859 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:18.997346 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fed5b-611f-4e31-80e9-047d96985859 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:18.998055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fed5b-611f-4e31-80e9-047d96985859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:18.998360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fed5b-611f-4e31-80e9-047d96985859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:19.000499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fed5b-611f-4e31-80e9-047d96985859 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:19.005082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 291/566] 10.222.0.58 () {56 vars in 1133 bytes} [Tue May 17 11:53:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:19.005678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7668a-35c6-4887-964d-7e437cf4f56c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.012838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 276/567] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:19.014078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cbcd4-4668-4cf2-84ac-4b72c83edffb None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.014372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cbcd4-4668-4cf2-84ac-4b72c83edffb None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.014649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cbcd4-4668-4cf2-84ac-4b72c83edffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.029950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-225cbcd4-4668-4cf2-84ac-4b72c83edffb None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:19.031629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-225cbcd4-4668-4cf2-84ac-4b72c83edffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:19.108253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 277/568] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:19.108253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16170a-bc70-477b-83a7-7dc7c04e6745 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.108253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16170a-bc70-477b-83a7-7dc7c04e6745 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.108253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16170a-bc70-477b-83a7-7dc7c04e6745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.109220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7668a-35c6-4887-964d-7e437cf4f56c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:19.114401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ea16170a-bc70-477b-83a7-7dc7c04e6745 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:19.115564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ea16170a-bc70-477b-83a7-7dc7c04e6745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:19.138201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ad97-7266-49a0-bd42-7392a77d88e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:19.138855 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ad97-7266-49a0-bd42-7392a77d88e2 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.139133 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ad97-7266-49a0-bd42-7392a77d88e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.139404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146ad97-7266-49a0-bd42-7392a77d88e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.140446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ad97-7266-49a0-bd42-7392a77d88e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:19.140579 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ad97-7266-49a0-bd42-7392a77d88e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:19.141946 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146ad97-7266-49a0-bd42-7392a77d88e2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:19.152652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 292/569] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:19.153261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ad97-7266-49a0-bd42-7392a77d88e2 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.179617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 278/570] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:19.180478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16170a-bc70-477b-83a7-7dc7c04e6745 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.259744 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146ad97-7266-49a0-bd42-7392a77d88e2 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:19.272316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16170a-bc70-477b-83a7-7dc7c04e6745 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:19.291373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11900d82-3063-4b98-8445-577535e42bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:19.292153 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11900d82-3063-4b98-8445-577535e42bb5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.292533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11900d82-3063-4b98-8445-577535e42bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.292741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11900d82-3063-4b98-8445-577535e42bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.303610 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11900d82-3063-4b98-8445-577535e42bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:19.305127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11900d82-3063-4b98-8445-577535e42bb5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:19.305233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fc231-6219-4ee7-be97-a60b4cbb87aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:19.305934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fc231-6219-4ee7-be97-a60b4cbb87aa None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.306217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fc231-6219-4ee7-be97-a60b4cbb87aa None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.306493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fc231-6219-4ee7-be97-a60b4cbb87aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.313776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fc231-6219-4ee7-be97-a60b4cbb87aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:19.315204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fc231-6219-4ee7-be97-a60b4cbb87aa None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-11900d82-3063-4b98-8445-577535e42bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:19.322392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:19.323258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:19.324079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:19.324079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:19.324079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:19.324079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:19.324079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 293/571] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:19.324719 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11900d82-3063-4b98-8445-577535e42bb5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-486fc231-6219-4ee7-be97-a60b4cbb87aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:19.329153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:19.329979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:19.331284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:19.331284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:19.331284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:19.331284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:19.331284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:19.331284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:19.331284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:19.331284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:19.331284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 279/572] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:19.331284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fc231-6219-4ee7-be97-a60b4cbb87aa None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.418096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11900d82-3063-4b98-8445-577535e42bb5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:19.432579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fc231-6219-4ee7-be97-a60b4cbb87aa None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:19.450838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dae26-51d0-46a8-8709-eb39bdb5bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:19.451721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dae26-51d0-46a8-8709-eb39bdb5bc06 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.451979 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dae26-51d0-46a8-8709-eb39bdb5bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.452303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dae26-51d0-46a8-8709-eb39bdb5bc06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.463249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dae26-51d0-46a8-8709-eb39bdb5bc06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:19.465853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4164c0a-b46e-41dc-9ca8-b17327ab843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:19.466640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4164c0a-b46e-41dc-9ca8-b17327ab843d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.466924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4164c0a-b46e-41dc-9ca8-b17327ab843d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.467200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4164c0a-b46e-41dc-9ca8-b17327ab843d None admin] PATH_INFO: `/v3/users/glance` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-329dae26-51d0-46a8-8709-eb39bdb5bc06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:19.470892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:19.471879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:19.472906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 294/573] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:19.473639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dae26-51d0-46a8-8709-eb39bdb5bc06 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.474738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4164c0a-b46e-41dc-9ca8-b17327ab843d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:19.476208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4164c0a-b46e-41dc-9ca8-b17327ab843d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-b4164c0a-b46e-41dc-9ca8-b17327ab843d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:19.490955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:19.492067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 280/574] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:19.493485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4164c0a-b46e-41dc-9ca8-b17327ab843d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.570138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dae26-51d0-46a8-8709-eb39bdb5bc06 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:19.587246 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4164c0a-b46e-41dc-9ca8-b17327ab843d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:19.601052 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46412-eb63-4653-82f7-82c42ecd647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:19.601843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46412-eb63-4653-82f7-82c42ecd647a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.602126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46412-eb63-4653-82f7-82c42ecd647a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.602402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46412-eb63-4653-82f7-82c42ecd647a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.612602 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e46412-eb63-4653-82f7-82c42ecd647a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:19.618648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516cebd-9403-48b7-9660-ba90501191de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:19.619298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516cebd-9403-48b7-9660-ba90501191de None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.619577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516cebd-9403-48b7-9660-ba90501191de None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.619847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516cebd-9403-48b7-9660-ba90501191de None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-d9e46412-eb63-4653-82f7-82c42ecd647a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:19.620235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:19.621260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:19.622255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:19.622990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516cebd-9403-48b7-9660-ba90501191de None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:19.622990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516cebd-9403-48b7-9660-ba90501191de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:19.622990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516cebd-9403-48b7-9660-ba90501191de None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:19.626801 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 295/575] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:19.627520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46412-eb63-4653-82f7-82c42ecd647a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.634211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 281/576] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:19.635031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516cebd-9403-48b7-9660-ba90501191de None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.722236 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46412-eb63-4653-82f7-82c42ecd647a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:19.727896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516cebd-9403-48b7-9660-ba90501191de None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:19.754057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab047441-c4f3-4d79-93a5-bc5d36329c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:19.754703 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab047441-c4f3-4d79-93a5-bc5d36329c4d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.754980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab047441-c4f3-4d79-93a5-bc5d36329c4d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.755251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab047441-c4f3-4d79-93a5-bc5d36329c4d None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.756021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab047441-c4f3-4d79-93a5-bc5d36329c4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:19.756377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab047441-c4f3-4d79-93a5-bc5d36329c4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:19.757802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab047441-c4f3-4d79-93a5-bc5d36329c4d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:19.760476 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48607c-1394-4fa1-9d8d-88aa9282f77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:19.761136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48607c-1394-4fa1-9d8d-88aa9282f77f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.761416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48607c-1394-4fa1-9d8d-88aa9282f77f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.761688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48607c-1394-4fa1-9d8d-88aa9282f77f None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.762427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48607c-1394-4fa1-9d8d-88aa9282f77f None admin] RBAC: Adding query filter params (name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:19.762733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48607c-1394-4fa1-9d8d-88aa9282f77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:19.764084 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48607c-1394-4fa1-9d8d-88aa9282f77f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:19.769139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 296/577] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:19.769918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab047441-c4f3-4d79-93a5-bc5d36329c4d None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.776145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 282/578] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:19.776145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48607c-1394-4fa1-9d8d-88aa9282f77f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.862574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab047441-c4f3-4d79-93a5-bc5d36329c4d None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:19.870268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48607c-1394-4fa1-9d8d-88aa9282f77f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:19.893777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d44e7b-a72e-4835-9193-0e62e0141960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:19.894433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d44e7b-a72e-4835-9193-0e62e0141960 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.894710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d44e7b-a72e-4835-9193-0e62e0141960 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.894986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d44e7b-a72e-4835-9193-0e62e0141960 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.895809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d44e7b-a72e-4835-9193-0e62e0141960 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:19.896117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d44e7b-a72e-4835-9193-0e62e0141960 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:19.897561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d44e7b-a72e-4835-9193-0e62e0141960 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:19.901369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f70c-7b8c-475d-9fe5-262b0162f616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:19.902025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f70c-7b8c-475d-9fe5-262b0162f616 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:19.902307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f70c-7b8c-475d-9fe5-262b0162f616 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:19.902580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7f70c-7b8c-475d-9fe5-262b0162f616 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:19.903316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f70c-7b8c-475d-9fe5-262b0162f616 None admin] RBAC: Adding query filter params (name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:19.903623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f70c-7b8c-475d-9fe5-262b0162f616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:19.904987 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7f70c-7b8c-475d-9fe5-262b0162f616 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:19.913347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 283/579] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:19.914129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f70c-7b8c-475d-9fe5-262b0162f616 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:19.914904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 297/580] 10.222.0.58 () {56 vars in 1137 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:19.915687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d44e7b-a72e-4835-9193-0e62e0141960 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.009990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d44e7b-a72e-4835-9193-0e62e0141960 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.012367 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7f70c-7b8c-475d-9fe5-262b0162f616 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.042440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c0ce5-2fe7-4bef-9679-f387b8fd91dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.043086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c0ce5-2fe7-4bef-9679-f387b8fd91dc None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.043374 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c0ce5-2fe7-4bef-9679-f387b8fd91dc None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.043646 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c0ce5-2fe7-4bef-9679-f387b8fd91dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.043964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b09012-9202-4de0-8345-f1958caa883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.044514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c0ce5-2fe7-4bef-9679-f387b8fd91dc None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=5206e8bbb04042f4b00637518f297a97) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:20.044799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09012-9202-4de0-8345-f1958caa883a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.044899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c0ce5-2fe7-4bef-9679-f387b8fd91dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.045086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09012-9202-4de0-8345-f1958caa883a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.045363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09012-9202-4de0-8345-f1958caa883a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.046932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c0ce5-2fe7-4bef-9679-f387b8fd91dc None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.052299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 298/581] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/role_assignments?user.id=5206e8bbb04042f4b00637518f297a97&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:20.052606 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b09012-9202-4de0-8345-f1958caa883a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.052914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c0ce5-2fe7-4bef-9679-f387b8fd91dc None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.054107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b09012-9202-4de0-8345-f1958caa883a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-e4b09012-9202-4de0-8345-f1958caa883a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:20.074107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:20.075066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:20.075931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:20.075931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:20.075931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:20.075931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:20.075931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:20.075931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:20.075931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:20.075931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:20.075931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 284/582] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:20.077111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b09012-9202-4de0-8345-f1958caa883a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.163786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c0ce5-2fe7-4bef-9679-f387b8fd91dc None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.188807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b09012-9202-4de0-8345-f1958caa883a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.199434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e849b-0f30-4a27-b4b6-2624e7d5abd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.200267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e849b-0f30-4a27-b4b6-2624e7d5abd9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.200554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e849b-0f30-4a27-b4b6-2624e7d5abd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.200830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e849b-0f30-4a27-b4b6-2624e7d5abd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.211971 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e849b-0f30-4a27-b4b6-2624e7d5abd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.213493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e849b-0f30-4a27-b4b6-2624e7d5abd9 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.224590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daed077-f819-4e9b-9800-d240a1484166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.225395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed077-f819-4e9b-9800-d240a1484166 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.225684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed077-f819-4e9b-9800-d240a1484166 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.225961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed077-f819-4e9b-9800-d240a1484166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-cb8e849b-0f30-4a27-b4b6-2624e7d5abd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:20.231270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:20.232126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:20.233281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:20.233281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:20.233281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:20.233281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:20.237229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 299/583] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:20.237229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e849b-0f30-4a27-b4b6-2624e7d5abd9 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.240272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daed077-f819-4e9b-9800-d240a1484166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.241574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daed077-f819-4e9b-9800-d240a1484166 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-6daed077-f819-4e9b-9800-d240a1484166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:20.259853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:20.260858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:20.261809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:20.261809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:20.261809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:20.261809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:20.261809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 285/584] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:20.262621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daed077-f819-4e9b-9800-d240a1484166 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.339224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e849b-0f30-4a27-b4b6-2624e7d5abd9 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.357371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daed077-f819-4e9b-9800-d240a1484166 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.379775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebe6be-67b7-40fd-9816-7c2dd1cc05e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.381389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebe6be-67b7-40fd-9816-7c2dd1cc05e4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.382107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebe6be-67b7-40fd-9816-7c2dd1cc05e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.382556 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebe6be-67b7-40fd-9816-7c2dd1cc05e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.391153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06baa00-ac74-458f-ab5e-0ec6210af10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.391815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06baa00-ac74-458f-ab5e-0ec6210af10d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.392096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06baa00-ac74-458f-ab5e-0ec6210af10d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.392398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06baa00-ac74-458f-ab5e-0ec6210af10d None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.393190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06baa00-ac74-458f-ab5e-0ec6210af10d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:20.393501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06baa00-ac74-458f-ab5e-0ec6210af10d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.394693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebe6be-67b7-40fd-9816-7c2dd1cc05e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.394993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06baa00-ac74-458f-ab5e-0ec6210af10d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.396527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebe6be-67b7-40fd-9816-7c2dd1cc05e4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.406447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 286/585] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:20.407266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06baa00-ac74-458f-ab5e-0ec6210af10d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-b3ebe6be-67b7-40fd-9816-7c2dd1cc05e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:20.415138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:20.415988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:20.416872 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:20.416872 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:20.416872 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:20.416872 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:20.417886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 300/586] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:20.418324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebe6be-67b7-40fd-9816-7c2dd1cc05e4 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.515298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06baa00-ac74-458f-ab5e-0ec6210af10d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.523240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebe6be-67b7-40fd-9816-7c2dd1cc05e4 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.559690 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef3e19-395b-4447-9fea-ad1a0d20216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.559925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff088a-9fce-4367-b53d-28da12ff941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.560638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef3e19-395b-4447-9fea-ad1a0d20216c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.560742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff088a-9fce-4367-b53d-28da12ff941c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.560926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef3e19-395b-4447-9fea-ad1a0d20216c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.561023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff088a-9fce-4367-b53d-28da12ff941c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.561186 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff088a-9fce-4367-b53d-28da12ff941c None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.561276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef3e19-395b-4447-9fea-ad1a0d20216c None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.562419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef3e19-395b-4447-9fea-ad1a0d20216c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:20.562563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff088a-9fce-4367-b53d-28da12ff941c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:20.562716 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef3e19-395b-4447-9fea-ad1a0d20216c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.562813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff088a-9fce-4367-b53d-28da12ff941c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.564106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef3e19-395b-4447-9fea-ad1a0d20216c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.564291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff088a-9fce-4367-b53d-28da12ff941c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.576274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 301/587] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:20.577079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff088a-9fce-4367-b53d-28da12ff941c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.578334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 287/588] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:20.580026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef3e19-395b-4447-9fea-ad1a0d20216c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.677185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff088a-9fce-4367-b53d-28da12ff941c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.677710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef3e19-395b-4447-9fea-ad1a0d20216c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.709382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387f26e-2d9b-466c-a7e0-1a91ac145d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.710260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387f26e-2d9b-466c-a7e0-1a91ac145d90 None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.710541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387f26e-2d9b-466c-a7e0-1a91ac145d90 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.710800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c74c0f-6a42-4e17-a610-c50ec05cbe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.710914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387f26e-2d9b-466c-a7e0-1a91ac145d90 None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/d86479ff40f54e7793f1771cb6ad362a/roles/50a905462253442da9d5dac9a4dd30ae` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.711460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c74c0f-6a42-4e17-a610-c50ec05cbe92 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.711742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c74c0f-6a42-4e17-a610-c50ec05cbe92 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.712017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c74c0f-6a42-4e17-a610-c50ec05cbe92 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.712771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c74c0f-6a42-4e17-a610-c50ec05cbe92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:20.713079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c74c0f-6a42-4e17-a610-c50ec05cbe92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.714555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c74c0f-6a42-4e17-a610-c50ec05cbe92 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.726736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387f26e-2d9b-466c-a7e0-1a91ac145d90 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=d86479ff40f54e7793f1771cb6ad362a, role_id=50a905462253442da9d5dac9a4dd30ae)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.726897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 288/589] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:20.727629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c74c0f-6a42-4e17-a610-c50ec05cbe92 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.728722 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387f26e-2d9b-466c-a7e0-1a91ac145d90 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.741736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 302/590] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:53:20 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/d86479ff40f54e7793f1771cb6ad362a/roles/50a905462253442da9d5dac9a4dd30ae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:53:20.742888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387f26e-2d9b-466c-a7e0-1a91ac145d90 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.853500 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387f26e-2d9b-466c-a7e0-1a91ac145d90 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.854334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c74c0f-6a42-4e17-a610-c50ec05cbe92 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:20.891871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783e6a-6c59-486d-9511-d7d65b5526e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.892526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb9be8-4692-4f56-b87f-7619e1ea715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:20.892746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783e6a-6c59-486d-9511-d7d65b5526e1 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.893014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783e6a-6c59-486d-9511-d7d65b5526e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.893299 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783e6a-6c59-486d-9511-d7d65b5526e1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.894393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9be8-4692-4f56-b87f-7619e1ea715c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:20.894899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9be8-4692-4f56-b87f-7619e1ea715c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:20.895370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9be8-4692-4f56-b87f-7619e1ea715c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:20.902173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77783e6a-6c59-486d-9511-d7d65b5526e1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.903665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77783e6a-6c59-486d-9511-d7d65b5526e1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.904268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb9be8-4692-4f56-b87f-7619e1ea715c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:20.906645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb9be8-4692-4f56-b87f-7619e1ea715c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-77783e6a-6c59-486d-9511-d7d65b5526e1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:20.920122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:20.921323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:20.922778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:20.922778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:20.922778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:20.922778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:20.922778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:20.922778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:20.922778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:20.922778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:20.922778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 11:53:20.922778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:20.922778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 289/591] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:20.923342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783e6a-6c59-486d-9511-d7d65b5526e1 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-76fb9be8-4692-4f56-b87f-7619e1ea715c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:20.926757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:20.927648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:20.928623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:20.928623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:20.928623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:20.928623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:20.928623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:20.928623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:20.928623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:20.928623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:20.928623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 11:53:20.928623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:20.935795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 303/592] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:20.937085 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb9be8-4692-4f56-b87f-7619e1ea715c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:21.027760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783e6a-6c59-486d-9511-d7d65b5526e1 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:21.037263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb9be8-4692-4f56-b87f-7619e1ea715c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:21.063344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf827-2e3b-4ff6-b8bc-26b9e1c8c44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:21.064454 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf827-2e3b-4ff6-b8bc-26b9e1c8c44b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:21.064911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf827-2e3b-4ff6-b8bc-26b9e1c8c44b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:21.065354 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf827-2e3b-4ff6-b8bc-26b9e1c8c44b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:21.072705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449491a-e644-495c-ab0b-140dbd038d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:21.072995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacf827-2e3b-4ff6-b8bc-26b9e1c8c44b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:21.073372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449491a-e644-495c-ab0b-140dbd038d6a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:21.073657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449491a-e644-495c-ab0b-140dbd038d6a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:21.073931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449491a-e644-495c-ab0b-140dbd038d6a None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:21.074772 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449491a-e644-495c-ab0b-140dbd038d6a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:21.075079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449491a-e644-495c-ab0b-140dbd038d6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:21.075638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacf827-2e3b-4ff6-b8bc-26b9e1c8c44b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:21.076526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449491a-e644-495c-ab0b-140dbd038d6a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-8bacf827-2e3b-4ff6-b8bc-26b9e1c8c44b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:21.090386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:21.091263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:21.092106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:21.092106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:21.092106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:21.092106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:21.092106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:21.092106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:21.092106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:21.092106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:21.094625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 304/593] 10.222.0.58 () {56 vars in 1139 bytes} [Tue May 17 11:53:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:21.099016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449491a-e644-495c-ab0b-140dbd038d6a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:21.099418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 290/594] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:21.100525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf827-2e3b-4ff6-b8bc-26b9e1c8c44b None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:21.196589 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449491a-e644-495c-ab0b-140dbd038d6a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:21.201564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf827-2e3b-4ff6-b8bc-26b9e1c8c44b None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:21.230898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3c0ae-cd94-4114-97f5-5902cfeaa8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:21.231574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c0ae-cd94-4114-97f5-5902cfeaa8aa None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:21.231858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c0ae-cd94-4114-97f5-5902cfeaa8aa None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:21.232137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c0ae-cd94-4114-97f5-5902cfeaa8aa None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:21.233008 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3c0ae-cd94-4114-97f5-5902cfeaa8aa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:21.233320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3c0ae-cd94-4114-97f5-5902cfeaa8aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:21.235378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3c0ae-cd94-4114-97f5-5902cfeaa8aa None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:21.238729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4f77d-0d5d-4dc9-9b1a-eefa705cde13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:21.239730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4f77d-0d5d-4dc9-9b1a-eefa705cde13 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:21.240228 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4f77d-0d5d-4dc9-9b1a-eefa705cde13 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:21.240690 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4f77d-0d5d-4dc9-9b1a-eefa705cde13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:21.251329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4f77d-0d5d-4dc9-9b1a-eefa705cde13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:21.253044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4f77d-0d5d-4dc9-9b1a-eefa705cde13 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:21.253405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 305/595] 10.222.0.58 () {56 vars in 1137 bytes} [Tue May 17 11:53:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:21.254254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3c0ae-cd94-4114-97f5-5902cfeaa8aa None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-5bc4f77d-0d5d-4dc9-9b1a-eefa705cde13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:21.272148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:21.273061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:21.273922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:21.273922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:21.273922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:21.273922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:21.280328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 291/596] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:21.281706 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4f77d-0d5d-4dc9-9b1a-eefa705cde13 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:21.356221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3c0ae-cd94-4114-97f5-5902cfeaa8aa None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:21.382395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4f77d-0d5d-4dc9-9b1a-eefa705cde13 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:21.392193 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e7eb7-fc96-46bb-95ef-6790d5229aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:21.392879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e7eb7-fc96-46bb-95ef-6790d5229aa4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:21.393165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e7eb7-fc96-46bb-95ef-6790d5229aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:21.393443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e7eb7-fc96-46bb-95ef-6790d5229aa4 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:21.394233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e7eb7-fc96-46bb-95ef-6790d5229aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:21.394541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e7eb7-fc96-46bb-95ef-6790d5229aa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:21.395994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e7eb7-fc96-46bb-95ef-6790d5229aa4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:21.408987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 306/597] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:21.409754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e7eb7-fc96-46bb-95ef-6790d5229aa4 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:21.420050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00cc20-ac61-4fef-9088-142db468cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:21.421762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00cc20-ac61-4fef-9088-142db468cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:21.422261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00cc20-ac61-4fef-9088-142db468cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:21.422729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00cc20-ac61-4fef-9088-142db468cbd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:21.432878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00cc20-ac61-4fef-9088-142db468cbd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:21.434521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00cc20-ac61-4fef-9088-142db468cbd1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-6a00cc20-ac61-4fef-9088-142db468cbd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:21.453382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:21.454247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:21.455093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:21.455093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:21.455093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:21.455093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:21.457375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 292/598] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:21.458679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00cc20-ac61-4fef-9088-142db468cbd1 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:21.518741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e7eb7-fc96-46bb-95ef-6790d5229aa4 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:21.553892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d046f-7363-4385-b8b7-09a27aad6f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:21.554563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d046f-7363-4385-b8b7-09a27aad6f33 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:21.554846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d046f-7363-4385-b8b7-09a27aad6f33 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:21.555121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d046f-7363-4385-b8b7-09a27aad6f33 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:21.555846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d046f-7363-4385-b8b7-09a27aad6f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:21.556156 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d046f-7363-4385-b8b7-09a27aad6f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:21.557726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d046f-7363-4385-b8b7-09a27aad6f33 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:21.574868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 307/599] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:21.574868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d046f-7363-4385-b8b7-09a27aad6f33 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:21.576769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00cc20-ac61-4fef-9088-142db468cbd1 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:21.612781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c89a80-a61d-4754-8c7a-1779b5d1fc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:21.614050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89a80-a61d-4754-8c7a-1779b5d1fc06 None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:21.614542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89a80-a61d-4754-8c7a-1779b5d1fc06 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:21.615009 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c89a80-a61d-4754-8c7a-1779b5d1fc06 None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/767fe573dff349918c26995c206f2155/roles/50a905462253442da9d5dac9a4dd30ae` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:21.630832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c89a80-a61d-4754-8c7a-1779b5d1fc06 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=767fe573dff349918c26995c206f2155, role_id=50a905462253442da9d5dac9a4dd30ae)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:21.632638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c89a80-a61d-4754-8c7a-1779b5d1fc06 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:21.647465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 293/600] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:53:21 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/767fe573dff349918c26995c206f2155/roles/50a905462253442da9d5dac9a4dd30ae => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:53:21.648721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c89a80-a61d-4754-8c7a-1779b5d1fc06 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:21.676677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d046f-7363-4385-b8b7-09a27aad6f33 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:21.714909 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0be5b-037f-4889-8a63-4d388f1d56ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:21.715484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0be5b-037f-4889-8a63-4d388f1d56ea None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:21.715863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0be5b-037f-4889-8a63-4d388f1d56ea None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:21.716147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0be5b-037f-4889-8a63-4d388f1d56ea None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:21.716937 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0be5b-037f-4889-8a63-4d388f1d56ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:21.717318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0be5b-037f-4889-8a63-4d388f1d56ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:21.718831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0be5b-037f-4889-8a63-4d388f1d56ea None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:21.732104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 308/601] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:21.739147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0be5b-037f-4889-8a63-4d388f1d56ea None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:21.759899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c89a80-a61d-4754-8c7a-1779b5d1fc06 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:21.797096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5fc75-64f5-4634-ab8c-483844e6aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:21.798196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5fc75-64f5-4634-ab8c-483844e6aab8 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:21.798621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5fc75-64f5-4634-ab8c-483844e6aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:21.799045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5fc75-64f5-4634-ab8c-483844e6aab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:21.806804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5fc75-64f5-4634-ab8c-483844e6aab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:21.808540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde5fc75-64f5-4634-ab8c-483844e6aab8 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-cde5fc75-64f5-4634-ab8c-483844e6aab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:21.824304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:21.825361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:21.826392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:21.826392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:21.826392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:21.826392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:21.826392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:21.826392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:21.826392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:21.826392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:21.828429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 294/602] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:21.837108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5fc75-64f5-4634-ab8c-483844e6aab8 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:21.956125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0be5b-037f-4889-8a63-4d388f1d56ea None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:21.991285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5fc75-64f5-4634-ab8c-483844e6aab8 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:22.021409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cca69-1470-45d9-a2c3-0132416087c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:22.022271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cca69-1470-45d9-a2c3-0132416087c6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:22.022555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cca69-1470-45d9-a2c3-0132416087c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:22.022833 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cca69-1470-45d9-a2c3-0132416087c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:22.041006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cca69-1470-45d9-a2c3-0132416087c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:22.042469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cca69-1470-45d9-a2c3-0132416087c6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:22.044057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea6630-5904-4d93-be22-c38b8fbafc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:22.044760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea6630-5904-4d93-be22-c38b8fbafc6a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:22.045093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea6630-5904-4d93-be22-c38b8fbafc6a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:22.045372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea6630-5904-4d93-be22-c38b8fbafc6a None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:22.047171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea6630-5904-4d93-be22-c38b8fbafc6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:22.047486 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea6630-5904-4d93-be22-c38b8fbafc6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:22.048925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea6630-5904-4d93-be22-c38b8fbafc6a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-a32cca69-1470-45d9-a2c3-0132416087c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:22.074476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:22.075389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:22.076290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:22.076290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:22.076290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:22.076290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:22.076290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:22.076290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:22.076290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:22.076290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:22.081618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 309/603] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:22.083877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 295/604] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:22.089579 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cca69-1470-45d9-a2c3-0132416087c6 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:22.090847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea6630-5904-4d93-be22-c38b8fbafc6a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:22.277889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea6630-5904-4d93-be22-c38b8fbafc6a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:22.285158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cca69-1470-45d9-a2c3-0132416087c6 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:22.324157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0613245-a512-410e-9b0d-02342916fcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:22.324382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfab11a-811c-40fc-88bb-d2a5dfa6877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:22.324809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0613245-a512-410e-9b0d-02342916fcc9 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:22.324982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfab11a-811c-40fc-88bb-d2a5dfa6877a None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:22.325074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0613245-a512-410e-9b0d-02342916fcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:22.325328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfab11a-811c-40fc-88bb-d2a5dfa6877a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:22.325436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0613245-a512-410e-9b0d-02342916fcc9 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:22.325611 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfab11a-811c-40fc-88bb-d2a5dfa6877a None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/95029e6140de425e86b5f9d7e2923bb0/roles/50a905462253442da9d5dac9a4dd30ae` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:22.326162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0613245-a512-410e-9b0d-02342916fcc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:22.326444 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0613245-a512-410e-9b0d-02342916fcc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:22.328535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0613245-a512-410e-9b0d-02342916fcc9 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:22.342568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfab11a-811c-40fc-88bb-d2a5dfa6877a None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=95029e6140de425e86b5f9d7e2923bb0, role_id=50a905462253442da9d5dac9a4dd30ae)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:22.345043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfab11a-811c-40fc-88bb-d2a5dfa6877a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:22.346049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 296/605] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:22.347295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0613245-a512-410e-9b0d-02342916fcc9 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:22.364875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 310/606] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:53:22 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/95029e6140de425e86b5f9d7e2923bb0/roles/50a905462253442da9d5dac9a4dd30ae => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:53:22.464033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ddbe3-baa3-4ac4-9685-c80bc180eb54 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:22.464409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ddbe3-baa3-4ac4-9685-c80bc180eb54 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:22.464628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ddbe3-baa3-4ac4-9685-c80bc180eb54 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:22.466311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 311/607] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:53:22.466701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0613245-a512-410e-9b0d-02342916fcc9 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:22.476602 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f43d4-c1c0-4c12-8c12-dad2ac65b419 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:22.476943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f43d4-c1c0-4c12-8c12-dad2ac65b419 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:22.477219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f43d4-c1c0-4c12-8c12-dad2ac65b419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:22.511445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934589d0-2b01-48c8-9d4c-b169de7b8067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:22.512080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-9d0f43d4-c1c0-4c12-8c12-dad2ac65b419 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:22.512384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934589d0-2b01-48c8-9d4c-b169de7b8067 None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:22.512669 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934589d0-2b01-48c8-9d4c-b169de7b8067 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:22.512947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934589d0-2b01-48c8-9d4c-b169de7b8067 None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/1b14c0c2f0cd4459915dbbe3b5939159/roles/50a905462253442da9d5dac9a4dd30ae` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:22.513323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9d0f43d4-c1c0-4c12-8c12-dad2ac65b419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:22.538934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934589d0-2b01-48c8-9d4c-b169de7b8067 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=1b14c0c2f0cd4459915dbbe3b5939159, role_id=50a905462253442da9d5dac9a4dd30ae)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:22.540452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934589d0-2b01-48c8-9d4c-b169de7b8067 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:22.567878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 297/608] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:53:22 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/1b14c0c2f0cd4459915dbbe3b5939159/roles/50a905462253442da9d5dac9a4dd30ae => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 11:53:22.632885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 312/609] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:22.666679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934589d0-2b01-48c8-9d4c-b169de7b8067 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:22.824893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934589d0-2b01-48c8-9d4c-b169de7b8067 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:22.869932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3328f4-b076-4650-800e-bf0d57a50e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:22.870737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3328f4-b076-4650-800e-bf0d57a50e5f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:22.871153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3328f4-b076-4650-800e-bf0d57a50e5f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:22.871452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3328f4-b076-4650-800e-bf0d57a50e5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:22.884280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3328f4-b076-4650-800e-bf0d57a50e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-1b3328f4-b076-4650-800e-bf0d57a50e5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:22.894533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:22.896881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:22.897729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 298/610] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:22.906560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f43d4-c1c0-4c12-8c12-dad2ac65b419 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:23.027800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f43d4-c1c0-4c12-8c12-dad2ac65b419 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:23.065870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09233b76-5115-433c-8894-181bf83cc3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:23.066653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233b76-5115-433c-8894-181bf83cc3d3 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:23.066820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233b76-5115-433c-8894-181bf83cc3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:23.067094 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233b76-5115-433c-8894-181bf83cc3d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:23.067866 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09233b76-5115-433c-8894-181bf83cc3d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:23.068197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09233b76-5115-433c-8894-181bf83cc3d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:23.069598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09233b76-5115-433c-8894-181bf83cc3d3 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:23.078930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 313/611] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:23.085110 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3328f4-b076-4650-800e-bf0d57a50e5f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:23.302555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3328f4-b076-4650-800e-bf0d57a50e5f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:23.350969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb793d-49e0-4651-93d6-45a75f4a7772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:23.352657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb793d-49e0-4651-93d6-45a75f4a7772 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:23.353156 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb793d-49e0-4651-93d6-45a75f4a7772 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:23.353630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb793d-49e0-4651-93d6-45a75f4a7772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:23.373091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb793d-49e0-4651-93d6-45a75f4a7772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:23.375453 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb793d-49e0-4651-93d6-45a75f4a7772 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-64fb793d-49e0-4651-93d6-45a75f4a7772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:23.398688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:23.399617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:23.400500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:23.400500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:23.400500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:23.400500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:23.402772 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 299/612] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:23.409097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09233b76-5115-433c-8894-181bf83cc3d3 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:23.450861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30099f-c43d-44a9-9650-389a9ba85b9a None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:23.451152 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30099f-c43d-44a9-9650-389a9ba85b9a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:23.453020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30099f-c43d-44a9-9650-389a9ba85b9a None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:23.453751 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 300/613] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:23.459278 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d759b7-1ce6-4bce-94f9-57adebd697cd None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:23.461658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d759b7-1ce6-4bce-94f9-57adebd697cd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:23.461658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d759b7-1ce6-4bce-94f9-57adebd697cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:23.478080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-60d759b7-1ce6-4bce-94f9-57adebd697cd None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:23.479320 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-60d759b7-1ce6-4bce-94f9-57adebd697cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:23.526865 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09233b76-5115-433c-8894-181bf83cc3d3 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:23.566285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e035b13-98f3-49bc-96cc-dcc0b69bafe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:23.567255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035b13-98f3-49bc-96cc-dcc0b69bafe8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:23.567759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035b13-98f3-49bc-96cc-dcc0b69bafe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:23.568130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035b13-98f3-49bc-96cc-dcc0b69bafe8 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:23.569085 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e035b13-98f3-49bc-96cc-dcc0b69bafe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:23.569589 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e035b13-98f3-49bc-96cc-dcc0b69bafe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:23.571091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e035b13-98f3-49bc-96cc-dcc0b69bafe8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:23.572871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 301/614] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:23.584380 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 314/615] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:23.589834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d759b7-1ce6-4bce-94f9-57adebd697cd None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:23.617590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e035b13-98f3-49bc-96cc-dcc0b69bafe8 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:23.738462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e035b13-98f3-49bc-96cc-dcc0b69bafe8 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:23.762261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d759b7-1ce6-4bce-94f9-57adebd697cd None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:23.773027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a94cb-f4c9-44d2-9f6a-072ae50b3e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:23.773828 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a94cb-f4c9-44d2-9f6a-072ae50b3e2a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:23.774105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a94cb-f4c9-44d2-9f6a-072ae50b3e2a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:23.774371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a94cb-f4c9-44d2-9f6a-072ae50b3e2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:23.786107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a94cb-f4c9-44d2-9f6a-072ae50b3e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-c31a94cb-f4c9-44d2-9f6a-072ae50b3e2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:23.793446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:23.794351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:23.795170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 315/616] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:23.803836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a94cb-f4c9-44d2-9f6a-072ae50b3e2a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:23.832913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e96301-cd8b-4477-ac5a-736c00c77dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:23.834078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96301-cd8b-4477-ac5a-736c00c77dcc None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:23.834562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96301-cd8b-4477-ac5a-736c00c77dcc None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:23.835042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96301-cd8b-4477-ac5a-736c00c77dcc None admin] PATH_INFO: `/v3/users/swift` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:23.842625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e96301-cd8b-4477-ac5a-736c00c77dcc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:23.844874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e96301-cd8b-4477-ac5a-736c00c77dcc None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-d4e96301-cd8b-4477-ac5a-736c00c77dcc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:23.860418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:23.861344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:23.862258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:23.862258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:23.862258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:23.862258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:23.862258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:23.862258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:23.862258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:23.862258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:23.862258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:23.862258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:23.864859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 302/617] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:23.870917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e96301-cd8b-4477-ac5a-736c00c77dcc None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:23.910792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a94cb-f4c9-44d2-9f6a-072ae50b3e2a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:23.944124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22a02b-5d11-4dc5-bdce-df8f1e3863bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:23.945136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22a02b-5d11-4dc5-bdce-df8f1e3863bb None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:23.945603 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22a02b-5d11-4dc5-bdce-df8f1e3863bb None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:23.946065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22a02b-5d11-4dc5-bdce-df8f1e3863bb None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:23.946982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22a02b-5d11-4dc5-bdce-df8f1e3863bb None admin] RBAC: Adding query filter params (name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:23.947471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22a02b-5d11-4dc5-bdce-df8f1e3863bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:23.949029 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22a02b-5d11-4dc5-bdce-df8f1e3863bb None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:23.957911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 316/618] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:23.964892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22a02b-5d11-4dc5-bdce-df8f1e3863bb None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:24.065902 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22a02b-5d11-4dc5-bdce-df8f1e3863bb None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:24.100263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262cbf4-e327-4c8f-9793-c71ef39da345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:24.101428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262cbf4-e327-4c8f-9793-c71ef39da345 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:24.101907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262cbf4-e327-4c8f-9793-c71ef39da345 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:24.102383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262cbf4-e327-4c8f-9793-c71ef39da345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:24.114626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262cbf4-e327-4c8f-9793-c71ef39da345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:24.116562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262cbf4-e327-4c8f-9793-c71ef39da345 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-a262cbf4-e327-4c8f-9793-c71ef39da345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:24.135819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:24.136729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:24.137588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:24.137588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:24.137588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:24.137588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:24.138310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e96301-cd8b-4477-ac5a-736c00c77dcc None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:24.140910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 317/619] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:24.146488 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262cbf4-e327-4c8f-9793-c71ef39da345 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:24.239743 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6810dd-4718-4a4a-b5f4-2066560df1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:24.240468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6810dd-4718-4a4a-b5f4-2066560df1eb None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:24.240754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6810dd-4718-4a4a-b5f4-2066560df1eb None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:24.241030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6810dd-4718-4a4a-b5f4-2066560df1eb None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:24.241886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6810dd-4718-4a4a-b5f4-2066560df1eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:24.242198 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6810dd-4718-4a4a-b5f4-2066560df1eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:24.243638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6810dd-4718-4a4a-b5f4-2066560df1eb None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:24.256644 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262cbf4-e327-4c8f-9793-c71ef39da345 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:24.290952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4032-1760-432c-98aa-6ee3ffccac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:24.292000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4032-1760-432c-98aa-6ee3ffccac15 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:24.292519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4032-1760-432c-98aa-6ee3ffccac15 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:24.293000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4032-1760-432c-98aa-6ee3ffccac15 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:24.293932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da4032-1760-432c-98aa-6ee3ffccac15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:24.294447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da4032-1760-432c-98aa-6ee3ffccac15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:24.296777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da4032-1760-432c-98aa-6ee3ffccac15 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:24.309517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 318/620] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:24.316039 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4032-1760-432c-98aa-6ee3ffccac15 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:24.317515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 303/621] 10.222.0.58 () {56 vars in 1135 bytes} [Tue May 17 11:53:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:24.344500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6810dd-4718-4a4a-b5f4-2066560df1eb None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:24.426660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4032-1760-432c-98aa-6ee3ffccac15 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:24.462385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840f3db-8f04-49b3-98e0-bcfc3a9a7a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:24.463185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f3db-8f04-49b3-98e0-bcfc3a9a7a51 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:24.463474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f3db-8f04-49b3-98e0-bcfc3a9a7a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:24.463768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840f3db-8f04-49b3-98e0-bcfc3a9a7a51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:24.471416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840f3db-8f04-49b3-98e0-bcfc3a9a7a51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:24.472980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840f3db-8f04-49b3-98e0-bcfc3a9a7a51 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:24.476272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6810dd-4718-4a4a-b5f4-2066560df1eb None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-1840f3db-8f04-49b3-98e0-bcfc3a9a7a51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:24.487547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:24.488740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:24.489875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:24.489875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:24.489875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:24.489875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:24.489875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:24.489875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:24.489875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:24.489875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:24.489875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:24.489875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:24.491985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 319/622] 10.222.0.58 () {56 vars in 1093 bytes} [Tue May 17 11:53:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:24.493472 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d967f-5f16-489a-b610-0c6ff90c0a4c None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:24.493949 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d967f-5f16-489a-b610-0c6ff90c0a4c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:24.494423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d967f-5f16-489a-b610-0c6ff90c0a4c None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:24.496276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 320/623] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:24.497155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d967f-5f16-489a-b610-0c6ff90c0a4c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:24.514164 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c10b93-5b1a-48ea-b780-15794b1e9fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:24.515493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10b93-5b1a-48ea-b780-15794b1e9fc0 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:24.515773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10b93-5b1a-48ea-b780-15794b1e9fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:24.516043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c10b93-5b1a-48ea-b780-15794b1e9fc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:24.528980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c10b93-5b1a-48ea-b780-15794b1e9fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:24.533504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c10b93-5b1a-48ea-b780-15794b1e9fc0 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-50c10b93-5b1a-48ea-b780-15794b1e9fc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:24.551226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:24.552145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:24.553256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:24.553256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:24.553256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:24.553256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:24.553256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 304/624] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:24.553999 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486048-f95f-4c75-9e73-04e901ac163f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:24.554286 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486048-f95f-4c75-9e73-04e901ac163f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:24.554559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486048-f95f-4c75-9e73-04e901ac163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:24.571789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-96486048-f95f-4c75-9e73-04e901ac163f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:24.572981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-96486048-f95f-4c75-9e73-04e901ac163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:24.610175 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d967f-5f16-489a-b610-0c6ff90c0a4c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:24.647008 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96478a0a-0c22-4513-ab19-00ffc330de48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:24.647284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 305/625] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:24.648101 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96486048-f95f-4c75-9e73-04e901ac163f None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:24.648378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478a0a-0c22-4513-ab19-00ffc330de48 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:24.648835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478a0a-0c22-4513-ab19-00ffc330de48 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:24.649299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96478a0a-0c22-4513-ab19-00ffc330de48 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:24.650332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96478a0a-0c22-4513-ab19-00ffc330de48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:24.650821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96478a0a-0c22-4513-ab19-00ffc330de48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:24.652507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96478a0a-0c22-4513-ab19-00ffc330de48 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:24.673672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 321/626] 10.222.0.58 () {56 vars in 1133 bytes} [Tue May 17 11:53:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:24.685533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96478a0a-0c22-4513-ab19-00ffc330de48 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:24.779918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96486048-f95f-4c75-9e73-04e901ac163f None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:24.814993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96478a0a-0c22-4513-ab19-00ffc330de48 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:24.824449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4228-31e0-4f83-86c4-ebecb713eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:24.825133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4228-31e0-4f83-86c4-ebecb713eb53 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:24.825415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4228-31e0-4f83-86c4-ebecb713eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:24.826008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4228-31e0-4f83-86c4-ebecb713eb53 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:24.827018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df4228-31e0-4f83-86c4-ebecb713eb53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:24.827501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df4228-31e0-4f83-86c4-ebecb713eb53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:24.829592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df4228-31e0-4f83-86c4-ebecb713eb53 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:24.844488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 306/627] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:24.845328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4228-31e0-4f83-86c4-ebecb713eb53 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:24.855587 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c8d8f-8a5e-441b-ad72-dd981f663b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:24.856691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c8d8f-8a5e-441b-ad72-dd981f663b1f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:24.857192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c8d8f-8a5e-441b-ad72-dd981f663b1f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:24.857671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c8d8f-8a5e-441b-ad72-dd981f663b1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:24.929086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c8d8f-8a5e-441b-ad72-dd981f663b1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:24.930918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c8d8f-8a5e-441b-ad72-dd981f663b1f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:24.972624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4228-31e0-4f83-86c4-ebecb713eb53 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:25.019726 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ebc77-98ba-4104-bef6-bd3548426c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:25.020938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ebc77-98ba-4104-bef6-bd3548426c48 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.021433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ebc77-98ba-4104-bef6-bd3548426c48 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.021900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ebc77-98ba-4104-bef6-bd3548426c48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.032917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ebc77-98ba-4104-bef6-bd3548426c48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-579ebc77-98ba-4104-bef6-bd3548426c48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:25.040958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:25.041844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:25.042651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:25.043264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 322/628] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:25.043835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c8d8f-8a5e-441b-ad72-dd981f663b1f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:25.045445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 307/629] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:25.047195 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ebc77-98ba-4104-bef6-bd3548426c48 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:25.146550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c8d8f-8a5e-441b-ad72-dd981f663b1f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:25.161263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ebc77-98ba-4104-bef6-bd3548426c48 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:25.185464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17942551-ef98-4ea3-9ffc-5f03a4af38b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:25.186388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17942551-ef98-4ea3-9ffc-5f03a4af38b4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.187427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17942551-ef98-4ea3-9ffc-5f03a4af38b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.187917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17942551-ef98-4ea3-9ffc-5f03a4af38b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.196408 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17942551-ef98-4ea3-9ffc-5f03a4af38b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:25.198267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17942551-ef98-4ea3-9ffc-5f03a4af38b4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:25.203591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41559033-7ad1-4d99-911a-7f0743bcadd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:25.204660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41559033-7ad1-4d99-911a-7f0743bcadd3 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.205080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41559033-7ad1-4d99-911a-7f0743bcadd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.205515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41559033-7ad1-4d99-911a-7f0743bcadd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-17942551-ef98-4ea3-9ffc-5f03a4af38b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:25.214219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:25.215248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:25.216138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:25.216138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:25.216138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:25.216138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:25.216138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:25.216138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:25.216138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:25.216138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:25.219585 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41559033-7ad1-4d99-911a-7f0743bcadd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:25.220436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 323/630] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:25.221375 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17942551-ef98-4ea3-9ffc-5f03a4af38b4 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:25.222111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41559033-7ad1-4d99-911a-7f0743bcadd3 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-41559033-7ad1-4d99-911a-7f0743bcadd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:25.239893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:25.240817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:25.241670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:25.241670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:25.241670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:25.241670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:25.248095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 308/631] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:25.249694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41559033-7ad1-4d99-911a-7f0743bcadd3 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:25.322226 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17942551-ef98-4ea3-9ffc-5f03a4af38b4 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:25.349969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41559033-7ad1-4d99-911a-7f0743bcadd3 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:25.356567 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0d167-0670-4bba-ac9f-ce2b60c53300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:25.357241 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0d167-0670-4bba-ac9f-ce2b60c53300 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.357525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0d167-0670-4bba-ac9f-ce2b60c53300 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.357799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0d167-0670-4bba-ac9f-ce2b60c53300 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.358731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0d167-0670-4bba-ac9f-ce2b60c53300 None admin] RBAC: Adding query filter params (name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:25.359069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0d167-0670-4bba-ac9f-ce2b60c53300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:25.361000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0d167-0670-4bba-ac9f-ce2b60c53300 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:25.369023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 324/632] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:25.369795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0d167-0670-4bba-ac9f-ce2b60c53300 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:25.385817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428269be-dbb0-42b5-a473-7bddfaeec2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:25.386476 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428269be-dbb0-42b5-a473-7bddfaeec2d6 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.386751 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428269be-dbb0-42b5-a473-7bddfaeec2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.387018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428269be-dbb0-42b5-a473-7bddfaeec2d6 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.387792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428269be-dbb0-42b5-a473-7bddfaeec2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:25.388100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428269be-dbb0-42b5-a473-7bddfaeec2d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:25.389531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428269be-dbb0-42b5-a473-7bddfaeec2d6 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:25.401553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 309/633] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:25.402756 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f69c1-d0f4-4a6c-ab0e-dbb6c42088d1 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.403037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f69c1-d0f4-4a6c-ab0e-dbb6c42088d1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.403311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f69c1-d0f4-4a6c-ab0e-dbb6c42088d1 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.404820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 310/634] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:25.405937 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1294d-4419-491d-a1de-cc4b4da15dfb None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.406214 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1294d-4419-491d-a1de-cc4b4da15dfb None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.406480 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1294d-4419-491d-a1de-cc4b4da15dfb None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.407688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 311/635] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:25.408396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1294d-4419-491d-a1de-cc4b4da15dfb None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:25.466700 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0d167-0670-4bba-ac9f-ce2b60c53300 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:25.498877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9eee9-eb76-4c68-9abe-e60f9b980dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:25.499507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9eee9-eb76-4c68-9abe-e60f9b980dc8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.499880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9eee9-eb76-4c68-9abe-e60f9b980dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.500159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9eee9-eb76-4c68-9abe-e60f9b980dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.500901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9eee9-eb76-4c68-9abe-e60f9b980dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:25.501209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9eee9-eb76-4c68-9abe-e60f9b980dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:25.502575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9eee9-eb76-4c68-9abe-e60f9b980dc8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:25.503739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1294d-4419-491d-a1de-cc4b4da15dfb None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:25.513899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 325/636] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:25.515183 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9eee9-eb76-4c68-9abe-e60f9b980dc8 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:25.537862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7c227-a7dd-4ddd-9de0-ce181382c70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:25.538648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7c227-a7dd-4ddd-9de0-ce181382c70b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.538924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7c227-a7dd-4ddd-9de0-ce181382c70b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.539192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7c227-a7dd-4ddd-9de0-ce181382c70b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.549489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7c227-a7dd-4ddd-9de0-ce181382c70b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:25.550908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7c227-a7dd-4ddd-9de0-ce181382c70b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-8bd7c227-a7dd-4ddd-9de0-ce181382c70b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:25.568063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:25.569147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:25.570463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:25.570463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:25.570463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:25.570463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:25.570463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 312/637] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:25.570753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfb6ef-01d0-400d-a672-8ed20363a8bb None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.570998 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfb6ef-01d0-400d-a672-8ed20363a8bb None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.571266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfb6ef-01d0-400d-a672-8ed20363a8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.587329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-b4bfb6ef-01d0-400d-a672-8ed20363a8bb None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:25.588535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b4bfb6ef-01d0-400d-a672-8ed20363a8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:25.618189 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9eee9-eb76-4c68-9abe-e60f9b980dc8 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:25.650456 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1024a-87b4-4e53-9350-d3e34f47ca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:25.651328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1024a-87b4-4e53-9350-d3e34f47ca56 None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.651613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1024a-87b4-4e53-9350-d3e34f47ca56 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.651706 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 313/638] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:25.651888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1024a-87b4-4e53-9350-d3e34f47ca56 None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/5206e8bbb04042f4b00637518f297a97/roles/50a905462253442da9d5dac9a4dd30ae` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.652983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e84b-3a74-4a04-837f-61c1eca3cb59 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.653311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e84b-3a74-4a04-837f-61c1eca3cb59 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.653590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e84b-3a74-4a04-837f-61c1eca3cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.666033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1024a-87b4-4e53-9350-d3e34f47ca56 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=5206e8bbb04042f4b00637518f297a97, role_id=50a905462253442da9d5dac9a4dd30ae)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:25.667483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1024a-87b4-4e53-9350-d3e34f47ca56 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:25.669030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a7a4e84b-3a74-4a04-837f-61c1eca3cb59 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:25.670175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a7a4e84b-3a74-4a04-837f-61c1eca3cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:25.681789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 326/639] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:53:25 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/5206e8bbb04042f4b00637518f297a97/roles/50a905462253442da9d5dac9a4dd30ae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:53:25.682609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1024a-87b4-4e53-9350-d3e34f47ca56 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:25.741713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 314/640] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:25.742972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4e84b-3a74-4a04-837f-61c1eca3cb59 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:25.812627 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1024a-87b4-4e53-9350-d3e34f47ca56 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:25.847975 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce50a-6f44-428a-84af-52a686d7d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:25.848818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce50a-6f44-428a-84af-52a686d7d191 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.849092 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce50a-6f44-428a-84af-52a686d7d191 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.849360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ce50a-6f44-428a-84af-52a686d7d191 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.856465 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ce50a-6f44-428a-84af-52a686d7d191 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:25.857919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ce50a-6f44-428a-84af-52a686d7d191 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:25.859029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4e84b-3a74-4a04-837f-61c1eca3cb59 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-9d9ce50a-6f44-428a-84af-52a686d7d191 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:25.874819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:25.875791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:25.876808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:25.876808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:25.876808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:25.876808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:25.876808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:25.876808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:25.876808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:25.876808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:25.877322 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 327/641] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:25.878350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce50a-6f44-428a-84af-52a686d7d191 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:25.899683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4551-5be8-46e4-97ac-7bd67fa1d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:25.900388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4551-5be8-46e4-97ac-7bd67fa1d6c2 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:25.900670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4551-5be8-46e4-97ac-7bd67fa1d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:25.900942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4551-5be8-46e4-97ac-7bd67fa1d6c2 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:25.901660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4551-5be8-46e4-97ac-7bd67fa1d6c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:25.901966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4551-5be8-46e4-97ac-7bd67fa1d6c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:25.903328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4551-5be8-46e4-97ac-7bd67fa1d6c2 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:25.914632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 315/642] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:25.915251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4551-5be8-46e4-97ac-7bd67fa1d6c2 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:25.980081 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ce50a-6f44-428a-84af-52a686d7d191 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.012559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4551-5be8-46e4-97ac-7bd67fa1d6c2 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.013537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c46b8-a9e8-49df-ac4f-76968476a342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.014330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c46b8-a9e8-49df-ac4f-76968476a342 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.015756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c46b8-a9e8-49df-ac4f-76968476a342 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.015756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c46b8-a9e8-49df-ac4f-76968476a342 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.025522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c46b8-a9e8-49df-ac4f-76968476a342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-d03c46b8-a9e8-49df-ac4f-76968476a342 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:26.033818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:26.034795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:26.035705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 328/643] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:26.036429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c46b8-a9e8-49df-ac4f-76968476a342 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:26.050520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcc42e-9b8f-4110-9e0c-5a932547a849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.051319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcc42e-9b8f-4110-9e0c-5a932547a849 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.051602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcc42e-9b8f-4110-9e0c-5a932547a849 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.051877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcc42e-9b8f-4110-9e0c-5a932547a849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.062497 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcc42e-9b8f-4110-9e0c-5a932547a849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-3bbcc42e-9b8f-4110-9e0c-5a932547a849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:26.070201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:26.071067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 316/644] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:26.076956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcc42e-9b8f-4110-9e0c-5a932547a849 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:26.134182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c46b8-a9e8-49df-ac4f-76968476a342 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.166172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915aba2-ccae-4b6c-ad44-8030200ff12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.166830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915aba2-ccae-4b6c-ad44-8030200ff12e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.167079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915aba2-ccae-4b6c-ad44-8030200ff12e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.167349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915aba2-ccae-4b6c-ad44-8030200ff12e None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.168123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915aba2-ccae-4b6c-ad44-8030200ff12e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:26.168453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915aba2-ccae-4b6c-ad44-8030200ff12e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:26.170001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915aba2-ccae-4b6c-ad44-8030200ff12e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:26.172666 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcc42e-9b8f-4110-9e0c-5a932547a849 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.182812 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 329/645] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:26.189185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915aba2-ccae-4b6c-ad44-8030200ff12e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:26.211797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a2c5-9166-481c-9848-da7527f4a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.212635 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a2c5-9166-481c-9848-da7527f4a611 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.212920 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a2c5-9166-481c-9848-da7527f4a611 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.213194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a2c5-9166-481c-9848-da7527f4a611 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.221357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256a2c5-9166-481c-9848-da7527f4a611 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:26.222814 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256a2c5-9166-481c-9848-da7527f4a611 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-6256a2c5-9166-481c-9848-da7527f4a611 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:26.237342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:26.238289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 317/646] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:26.243976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a2c5-9166-481c-9848-da7527f4a611 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:26.283037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915aba2-ccae-4b6c-ad44-8030200ff12e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.316459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b514-9ce0-4cfe-93e0-96cb2ee1936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.317135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b514-9ce0-4cfe-93e0-96cb2ee1936e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.317400 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b514-9ce0-4cfe-93e0-96cb2ee1936e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.317669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b514-9ce0-4cfe-93e0-96cb2ee1936e None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.318424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29b514-9ce0-4cfe-93e0-96cb2ee1936e None admin] RBAC: Adding query filter params (name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:26.318708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29b514-9ce0-4cfe-93e0-96cb2ee1936e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:26.320060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29b514-9ce0-4cfe-93e0-96cb2ee1936e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:26.332911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 330/647] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:26.332911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b514-9ce0-4cfe-93e0-96cb2ee1936e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:26.344827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a2c5-9166-481c-9848-da7527f4a611 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.378860 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704faf5-355e-48d9-8008-86685721df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.379532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704faf5-355e-48d9-8008-86685721df7e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.379816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704faf5-355e-48d9-8008-86685721df7e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.380094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704faf5-355e-48d9-8008-86685721df7e None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.380876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704faf5-355e-48d9-8008-86685721df7e None admin] RBAC: Adding query filter params (name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:26.381187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704faf5-355e-48d9-8008-86685721df7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:26.382554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704faf5-355e-48d9-8008-86685721df7e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:26.394992 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 318/648] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:26.394992 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704faf5-355e-48d9-8008-86685721df7e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:26.428773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b514-9ce0-4cfe-93e0-96cb2ee1936e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.463472 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e60ea7-df19-424b-90fa-7a93b8dd68fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.464124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e60ea7-df19-424b-90fa-7a93b8dd68fd None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.464433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e60ea7-df19-424b-90fa-7a93b8dd68fd None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.464703 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e60ea7-df19-424b-90fa-7a93b8dd68fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.465525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e60ea7-df19-424b-90fa-7a93b8dd68fd None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=d86479ff40f54e7793f1771cb6ad362a) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:26.465832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e60ea7-df19-424b-90fa-7a93b8dd68fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:26.467247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e60ea7-df19-424b-90fa-7a93b8dd68fd None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:26.484357 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 331/649] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:26 2022] GET /identity/v3/role_assignments?user.id=d86479ff40f54e7793f1771cb6ad362a&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:26.484357 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e60ea7-df19-424b-90fa-7a93b8dd68fd None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:26.494428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704faf5-355e-48d9-8008-86685721df7e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.542307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cca48b-4caa-4853-8573-781a5ac8d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.543151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cca48b-4caa-4853-8573-781a5ac8d87f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.543553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cca48b-4caa-4853-8573-781a5ac8d87f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.543924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cca48b-4caa-4853-8573-781a5ac8d87f None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.545283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cca48b-4caa-4853-8573-781a5ac8d87f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:26.545692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cca48b-4caa-4853-8573-781a5ac8d87f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:26.548846 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cca48b-4caa-4853-8573-781a5ac8d87f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:26.569766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 319/650] 10.222.0.58 () {56 vars in 1137 bytes} [Tue May 17 11:53:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:26.575115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cca48b-4caa-4853-8573-781a5ac8d87f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:26.599302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e60ea7-df19-424b-90fa-7a93b8dd68fd None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.634876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9d0de-2adc-4b02-b44e-d18ac9de03df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.635688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9d0de-2adc-4b02-b44e-d18ac9de03df None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.635973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9d0de-2adc-4b02-b44e-d18ac9de03df None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.636292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9d0de-2adc-4b02-b44e-d18ac9de03df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.648047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9d0de-2adc-4b02-b44e-d18ac9de03df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:26.649728 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9d0de-2adc-4b02-b44e-d18ac9de03df None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-ebe9d0de-2adc-4b02-b44e-d18ac9de03df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:26.668258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:26.669211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:26.670080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:26.670080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:26.670080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:26.670080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:26.674415 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 332/651] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:26.676301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9d0de-2adc-4b02-b44e-d18ac9de03df None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:26.681819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cca48b-4caa-4853-8573-781a5ac8d87f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.726145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df6f03-ddf7-441c-b8af-02a99cee26eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.726955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df6f03-ddf7-441c-b8af-02a99cee26eb None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.727243 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df6f03-ddf7-441c-b8af-02a99cee26eb None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.727522 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df6f03-ddf7-441c-b8af-02a99cee26eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.739611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df6f03-ddf7-441c-b8af-02a99cee26eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:26.741106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df6f03-ddf7-441c-b8af-02a99cee26eb None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-a2df6f03-ddf7-441c-b8af-02a99cee26eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:26.762150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:26.763073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:26.763924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:26.763924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:26.763924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:26.763924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:26.763924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 320/652] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:26.764261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df6f03-ddf7-441c-b8af-02a99cee26eb None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:26.805635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9d0de-2adc-4b02-b44e-d18ac9de03df None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.850734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4b32b-c40c-4725-b804-753b28f0daee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.851337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4b32b-c40c-4725-b804-753b28f0daee None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.851663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4b32b-c40c-4725-b804-753b28f0daee None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.851941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4b32b-c40c-4725-b804-753b28f0daee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.880237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df6f03-ddf7-441c-b8af-02a99cee26eb None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:26.915441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d35ae-0135-4fa8-9cf2-a9472f254458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:26.916602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d35ae-0135-4fa8-9cf2-a9472f254458 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:26.917087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d35ae-0135-4fa8-9cf2-a9472f254458 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:26.917607 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d35ae-0135-4fa8-9cf2-a9472f254458 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:26.918531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d35ae-0135-4fa8-9cf2-a9472f254458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:26.919106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d35ae-0135-4fa8-9cf2-a9472f254458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:26.920736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d35ae-0135-4fa8-9cf2-a9472f254458 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:26.933119 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 321/653] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:26.936366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4b32b-c40c-4725-b804-753b28f0daee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:26.938181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4b32b-c40c-4725-b804-753b28f0daee None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:26.938521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d35ae-0135-4fa8-9cf2-a9472f254458 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:27.042462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d35ae-0135-4fa8-9cf2-a9472f254458 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:27.053987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 333/654] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:27.055153 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4b32b-c40c-4725-b804-753b28f0daee None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:27.077577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93581dc-8d36-4172-ae28-50b6a067f7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:27.078328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93581dc-8d36-4172-ae28-50b6a067f7b9 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:27.078615 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93581dc-8d36-4172-ae28-50b6a067f7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:27.078894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93581dc-8d36-4172-ae28-50b6a067f7b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:27.079620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93581dc-8d36-4172-ae28-50b6a067f7b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:27.079931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93581dc-8d36-4172-ae28-50b6a067f7b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:27.081350 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93581dc-8d36-4172-ae28-50b6a067f7b9 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:27.098205 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 322/655] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:27.098205 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93581dc-8d36-4172-ae28-50b6a067f7b9 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:27.160989 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4b32b-c40c-4725-b804-753b28f0daee None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:27.194014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93581dc-8d36-4172-ae28-50b6a067f7b9 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:27.196081 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc0c73-d570-485e-9c46-3a241236a7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:27.197417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc0c73-d570-485e-9c46-3a241236a7f5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:27.197911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc0c73-d570-485e-9c46-3a241236a7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:27.198390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc0c73-d570-485e-9c46-3a241236a7f5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:27.206601 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc0c73-d570-485e-9c46-3a241236a7f5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:27.208368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc0c73-d570-485e-9c46-3a241236a7f5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-7ccc0c73-d570-485e-9c46-3a241236a7f5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:27.224152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:27.225093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:27.225997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:27.225997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:27.225997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:27.225997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:27.225997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:27.225997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:27.225997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:27.225997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:27.225997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 11:53:27.225997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:27.228289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 334/656] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:27.228390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5799ab-84ad-4c5f-b5af-f335ffafe2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:27.229155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5799ab-84ad-4c5f-b5af-f335ffafe2e1 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:27.229435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5799ab-84ad-4c5f-b5af-f335ffafe2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:27.229710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5799ab-84ad-4c5f-b5af-f335ffafe2e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:27.230003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc0c73-d570-485e-9c46-3a241236a7f5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:27.247651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5799ab-84ad-4c5f-b5af-f335ffafe2e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:27.250212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5799ab-84ad-4c5f-b5af-f335ffafe2e1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-0a5799ab-84ad-4c5f-b5af-f335ffafe2e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:27.271485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:27.272412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:27.273291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:27.273291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:27.273291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:27.273291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:27.279748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 323/657] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:27.280928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5799ab-84ad-4c5f-b5af-f335ffafe2e1 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:27.353166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc0c73-d570-485e-9c46-3a241236a7f5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:27.392054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986ec86-e57e-470c-9e84-515e185e1db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:27.392414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5799ab-84ad-4c5f-b5af-f335ffafe2e1 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:27.393400 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986ec86-e57e-470c-9e84-515e185e1db3 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:27.393900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986ec86-e57e-470c-9e84-515e185e1db3 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:27.394376 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986ec86-e57e-470c-9e84-515e185e1db3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:27.402172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986ec86-e57e-470c-9e84-515e185e1db3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:27.403897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986ec86-e57e-470c-9e84-515e185e1db3 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-b986ec86-e57e-470c-9e84-515e185e1db3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:27.419364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:27.420395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:27.421962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:27.421962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:27.421962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:27.421962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:27.421962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:27.421962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:27.421962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:27.421962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:27.421962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 11:53:27.421962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:27.428277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572864b2-65e3-455a-b3ea-efe7eb3f5d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:27.428775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 335/658] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:27.428944 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572864b2-65e3-455a-b3ea-efe7eb3f5d4b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:27.429229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572864b2-65e3-455a-b3ea-efe7eb3f5d4b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:27.429506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572864b2-65e3-455a-b3ea-efe7eb3f5d4b None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:27.430351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572864b2-65e3-455a-b3ea-efe7eb3f5d4b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:27.430576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986ec86-e57e-470c-9e84-515e185e1db3 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:27.430674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572864b2-65e3-455a-b3ea-efe7eb3f5d4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:27.432543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572864b2-65e3-455a-b3ea-efe7eb3f5d4b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:27.451747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 324/659] 10.222.0.58 () {56 vars in 1139 bytes} [Tue May 17 11:53:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:27.457584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572864b2-65e3-455a-b3ea-efe7eb3f5d4b None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:27.535532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986ec86-e57e-470c-9e84-515e185e1db3 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:27.566054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572864b2-65e3-455a-b3ea-efe7eb3f5d4b None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:27.570789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44160dfa-2d65-403a-9f3d-acd8f6924859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:27.571701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44160dfa-2d65-403a-9f3d-acd8f6924859 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:27.572220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44160dfa-2d65-403a-9f3d-acd8f6924859 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:27.572707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44160dfa-2d65-403a-9f3d-acd8f6924859 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:27.573617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44160dfa-2d65-403a-9f3d-acd8f6924859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:27.574117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44160dfa-2d65-403a-9f3d-acd8f6924859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:27.575669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44160dfa-2d65-403a-9f3d-acd8f6924859 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:27.592171 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 336/660] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:27.593925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44160dfa-2d65-403a-9f3d-acd8f6924859 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:27.601725 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f79df-a843-42e7-9c12-1f546b59f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:27.602403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f79df-a843-42e7-9c12-1f546b59f265 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:27.602686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f79df-a843-42e7-9c12-1f546b59f265 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:27.603012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f79df-a843-42e7-9c12-1f546b59f265 None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:27.603985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f79df-a843-42e7-9c12-1f546b59f265 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:27.604239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f79df-a843-42e7-9c12-1f546b59f265 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:27.605736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f79df-a843-42e7-9c12-1f546b59f265 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:27.629083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 325/661] 10.222.0.58 () {56 vars in 1137 bytes} [Tue May 17 11:53:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:27.629083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f79df-a843-42e7-9c12-1f546b59f265 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:27.699255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44160dfa-2d65-403a-9f3d-acd8f6924859 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:27.726072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f79df-a843-42e7-9c12-1f546b59f265 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:27.733858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993314a9-d820-4b21-97e4-b99aeb870e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:27.734791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993314a9-d820-4b21-97e4-b99aeb870e00 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:27.735345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993314a9-d820-4b21-97e4-b99aeb870e00 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:27.735814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993314a9-d820-4b21-97e4-b99aeb870e00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:27.763283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409d525-3a98-4719-a285-7977bb9d6887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:27.764124 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409d525-3a98-4719-a285-7977bb9d6887 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:27.764405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409d525-3a98-4719-a285-7977bb9d6887 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:27.765238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409d525-3a98-4719-a285-7977bb9d6887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:27.773382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409d525-3a98-4719-a285-7977bb9d6887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:27.775072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409d525-3a98-4719-a285-7977bb9d6887 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-2409d525-3a98-4719-a285-7977bb9d6887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:27.790450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:27.791391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:27.792305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:27.792305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:27.792305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:27.792305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:27.792305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:27.792305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:27.792305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:27.792305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:27.796881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 326/662] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:27.797807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409d525-3a98-4719-a285-7977bb9d6887 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:27.818505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993314a9-d820-4b21-97e4-b99aeb870e00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:27.820339 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993314a9-d820-4b21-97e4-b99aeb870e00 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:27.900617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409d525-3a98-4719-a285-7977bb9d6887 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:27.925634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 337/663] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:27.926877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993314a9-d820-4b21-97e4-b99aeb870e00 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:27.935631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14136a2d-1426-47f5-b097-cc3c9553a90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:27.936160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136a2d-1426-47f5-b097-cc3c9553a90f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:27.936525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136a2d-1426-47f5-b097-cc3c9553a90f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:27.936809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14136a2d-1426-47f5-b097-cc3c9553a90f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.003435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14136a2d-1426-47f5-b097-cc3c9553a90f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:28.004833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14136a2d-1426-47f5-b097-cc3c9553a90f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:28.025793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993314a9-d820-4b21-97e4-b99aeb870e00 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:28.062053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364f64d-346a-4beb-98ad-132392c75ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:28.062846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364f64d-346a-4beb-98ad-132392c75ee9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:28.063442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364f64d-346a-4beb-98ad-132392c75ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:28.063723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364f64d-346a-4beb-98ad-132392c75ee9 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.064790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364f64d-346a-4beb-98ad-132392c75ee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:28.065099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364f64d-346a-4beb-98ad-132392c75ee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:28.066686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364f64d-346a-4beb-98ad-132392c75ee9 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:28.085764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 338/664] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:28.085764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364f64d-346a-4beb-98ad-132392c75ee9 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:28.099649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 327/665] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:28.101265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bff7d-2171-45d4-a793-a59d0015f351 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:28.101619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bff7d-2171-45d4-a793-a59d0015f351 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:28.101967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bff7d-2171-45d4-a793-a59d0015f351 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.103440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 328/666] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:28.104044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bff7d-2171-45d4-a793-a59d0015f351 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:28.190374 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364f64d-346a-4beb-98ad-132392c75ee9 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:28.212474 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bff7d-2171-45d4-a793-a59d0015f351 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:28.225271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5a994-3df5-437c-998a-5b95e5fac91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:28.226056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a994-3df5-437c-998a-5b95e5fac91d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:28.226333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a994-3df5-437c-998a-5b95e5fac91d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:28.226604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5a994-3df5-437c-998a-5b95e5fac91d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.237994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5a994-3df5-437c-998a-5b95e5fac91d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:28.239448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5a994-3df5-437c-998a-5b95e5fac91d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:28.247164 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871fce8-edd4-4257-9925-6ebdcb7090c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:28.247809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fce8-edd4-4257-9925-6ebdcb7090c0 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:28.248090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fce8-edd4-4257-9925-6ebdcb7090c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:28.248392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fce8-edd4-4257-9925-6ebdcb7090c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.249280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871fce8-edd4-4257-9925-6ebdcb7090c0 None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=767fe573dff349918c26995c206f2155) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:28.249730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871fce8-edd4-4257-9925-6ebdcb7090c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:28.251044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871fce8-edd4-4257-9925-6ebdcb7090c0 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-78a5a994-3df5-437c-998a-5b95e5fac91d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:28.256745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:28.257608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:28.258508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:28.258508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:28.258508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:28.258508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:28.258737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 329/667] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:28 2022] GET /identity/v3/role_assignments?user.id=767fe573dff349918c26995c206f2155&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:28.258737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871fce8-edd4-4257-9925-6ebdcb7090c0 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:28.265805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 339/668] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:28.267542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f55dee-2fff-44e1-8555-3358d946c5b4 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:28.268103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f55dee-2fff-44e1-8555-3358d946c5b4 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:28.268667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f55dee-2fff-44e1-8555-3358d946c5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.291856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-71f55dee-2fff-44e1-8555-3358d946c5b4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:28.294094 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-71f55dee-2fff-44e1-8555-3358d946c5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:28.372588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 340/669] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:28.373705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f55dee-2fff-44e1-8555-3358d946c5b4 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:28.390536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871fce8-edd4-4257-9925-6ebdcb7090c0 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:28.428225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc55a37-3134-4c12-86f7-c2446c165278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:28.429376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc55a37-3134-4c12-86f7-c2446c165278 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:28.429840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc55a37-3134-4c12-86f7-c2446c165278 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:28.430400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc55a37-3134-4c12-86f7-c2446c165278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.443053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc55a37-3134-4c12-86f7-c2446c165278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:28.444899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc55a37-3134-4c12-86f7-c2446c165278 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-cdc55a37-3134-4c12-86f7-c2446c165278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:28.465154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:28.466090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:28.466959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:28.466959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:28.466959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:28.466959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:28.466959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 330/670] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:28.467235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc55a37-3134-4c12-86f7-c2446c165278 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:28.525833 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f55dee-2fff-44e1-8555-3358d946c5b4 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:28.574506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb54bb-4418-449f-baa3-e85b72d37a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:28.575196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb54bb-4418-449f-baa3-e85b72d37a4c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:28.575482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb54bb-4418-449f-baa3-e85b72d37a4c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:28.575759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb54bb-4418-449f-baa3-e85b72d37a4c None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.576580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb54bb-4418-449f-baa3-e85b72d37a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:28.576892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb54bb-4418-449f-baa3-e85b72d37a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:28.578386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb54bb-4418-449f-baa3-e85b72d37a4c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:28.593785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 341/671] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:28.595041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb54bb-4418-449f-baa3-e85b72d37a4c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:28.606730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc55a37-3134-4c12-86f7-c2446c165278 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:28.656526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6c6fe-e6c4-46c1-aa01-fe172fedbc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:28.657394 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6c6fe-e6c4-46c1-aa01-fe172fedbc9a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:28.657682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6c6fe-e6c4-46c1-aa01-fe172fedbc9a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:28.657958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6c6fe-e6c4-46c1-aa01-fe172fedbc9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.671381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6c6fe-e6c4-46c1-aa01-fe172fedbc9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-84d6c6fe-e6c4-46c1-aa01-fe172fedbc9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:28.679481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:28.680403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:28.681239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 331/672] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:28.681906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6c6fe-e6c4-46c1-aa01-fe172fedbc9a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:28.721737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb54bb-4418-449f-baa3-e85b72d37a4c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:28.758399 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232dead-cd48-48ce-bf77-ffb9a08d34ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:28.759609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232dead-cd48-48ce-bf77-ffb9a08d34ae None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:28.760057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232dead-cd48-48ce-bf77-ffb9a08d34ae None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:28.760489 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232dead-cd48-48ce-bf77-ffb9a08d34ae None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.761389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232dead-cd48-48ce-bf77-ffb9a08d34ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:28.761596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232dead-cd48-48ce-bf77-ffb9a08d34ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:28.763021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232dead-cd48-48ce-bf77-ffb9a08d34ae None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:28.781645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 342/673] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:28.781645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232dead-cd48-48ce-bf77-ffb9a08d34ae None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:28.809357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6c6fe-e6c4-46c1-aa01-fe172fedbc9a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:28.845938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ce4f4-56b5-435f-a655-c9735d772f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:28.846787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ce4f4-56b5-435f-a655-c9735d772f63 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:28.846999 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ce4f4-56b5-435f-a655-c9735d772f63 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:28.847267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ce4f4-56b5-435f-a655-c9735d772f63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.854252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ce4f4-56b5-435f-a655-c9735d772f63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:28.855735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ce4f4-56b5-435f-a655-c9735d772f63 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-881ce4f4-56b5-435f-a655-c9735d772f63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:28.870724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:28.871616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:28.872886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:28.872886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:28.872886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:28.872886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:28.872886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:28.872886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:28.872886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:28.872886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:28.872886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 332/674] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:28.873352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ce4f4-56b5-435f-a655-c9735d772f63 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:28.910680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232dead-cd48-48ce-bf77-ffb9a08d34ae None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:28.960711 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcde2a-aeb1-41fc-8208-29b49a6073e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:28.961382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcde2a-aeb1-41fc-8208-29b49a6073e5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:28.961667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcde2a-aeb1-41fc-8208-29b49a6073e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:28.961948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcde2a-aeb1-41fc-8208-29b49a6073e5 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:28.962700 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcde2a-aeb1-41fc-8208-29b49a6073e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:28.963008 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcde2a-aeb1-41fc-8208-29b49a6073e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:28.964416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcde2a-aeb1-41fc-8208-29b49a6073e5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:28.973462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 343/675] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:28.974264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcde2a-aeb1-41fc-8208-29b49a6073e5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:28.984383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ce4f4-56b5-435f-a655-c9735d772f63 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:29.017997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b36dc-bdde-4714-bbcd-98b78e14be78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:29.018783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b36dc-bdde-4714-bbcd-98b78e14be78 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.019063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b36dc-bdde-4714-bbcd-98b78e14be78 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.019338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b36dc-bdde-4714-bbcd-98b78e14be78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.026012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b36dc-bdde-4714-bbcd-98b78e14be78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:29.027450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b36dc-bdde-4714-bbcd-98b78e14be78 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-f46b36dc-bdde-4714-bbcd-98b78e14be78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:29.041934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:29.042781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:29.043631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:29.043631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:29.043631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:29.043631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:29.043631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:29.043631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:29.043631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:29.043631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:29.043631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 333/676] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:29.044577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2970d-a98f-4a6e-968e-089b32f1c737 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.044577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2970d-a98f-4a6e-968e-089b32f1c737 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.044824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2970d-a98f-4a6e-968e-089b32f1c737 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.046782 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 334/677] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:29.048667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2970d-a98f-4a6e-968e-089b32f1c737 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:29.080480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcde2a-aeb1-41fc-8208-29b49a6073e5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:29.122275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d0500-6d59-4f6a-98d3-342c83efe93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:29.122945 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d0500-6d59-4f6a-98d3-342c83efe93e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.123228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d0500-6d59-4f6a-98d3-342c83efe93e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.123504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d0500-6d59-4f6a-98d3-342c83efe93e None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.124488 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d0500-6d59-4f6a-98d3-342c83efe93e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:29.124890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d0500-6d59-4f6a-98d3-342c83efe93e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:29.126797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d0500-6d59-4f6a-98d3-342c83efe93e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:29.138868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 344/678] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:29.140170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d0500-6d59-4f6a-98d3-342c83efe93e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:29.157718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2970d-a98f-4a6e-968e-089b32f1c737 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:29.194603 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdc28a-9614-4712-a8f2-78975f8df192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:29.195405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdc28a-9614-4712-a8f2-78975f8df192 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.195686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdc28a-9614-4712-a8f2-78975f8df192 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.195963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdc28a-9614-4712-a8f2-78975f8df192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.206752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdc28a-9614-4712-a8f2-78975f8df192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:29.208438 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdc28a-9614-4712-a8f2-78975f8df192 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-ecbdc28a-9614-4712-a8f2-78975f8df192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:29.225220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:29.226582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:29.227449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:29.227449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:29.227449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:29.227449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:29.227449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 335/679] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:29.227721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ba0d-2d4a-4469-b226-bd5c8314cb64 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.228419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ba0d-2d4a-4469-b226-bd5c8314cb64 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.228419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ba0d-2d4a-4469-b226-bd5c8314cb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.244537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-9c39ba0d-2d4a-4469-b226-bd5c8314cb64 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:29.245713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9c39ba0d-2d4a-4469-b226-bd5c8314cb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:29.250698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d0500-6d59-4f6a-98d3-342c83efe93e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:29.283601 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2d2d-0aef-4b52-a2b9-47f7b431fdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:29.284286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2d2d-0aef-4b52-a2b9-47f7b431fdcb None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.284575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2d2d-0aef-4b52-a2b9-47f7b431fdcb None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.284855 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2d2d-0aef-4b52-a2b9-47f7b431fdcb None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.285890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c2d2d-0aef-4b52-a2b9-47f7b431fdcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:29.285997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c2d2d-0aef-4b52-a2b9-47f7b431fdcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:29.287390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c2d2d-0aef-4b52-a2b9-47f7b431fdcb None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:29.303946 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 345/680] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:29.303946 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2d2d-0aef-4b52-a2b9-47f7b431fdcb None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:29.324355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 336/681] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:29.324355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ba0d-2d4a-4469-b226-bd5c8314cb64 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:29.414405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ba0d-2d4a-4469-b226-bd5c8314cb64 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:29.415356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2d2d-0aef-4b52-a2b9-47f7b431fdcb None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:29.450754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a32e2e-8b71-4476-9a15-71b1e421f6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:29.451512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a32e2e-8b71-4476-9a15-71b1e421f6e6 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.451810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a32e2e-8b71-4476-9a15-71b1e421f6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.452611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a32e2e-8b71-4476-9a15-71b1e421f6e6 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.453610 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a32e2e-8b71-4476-9a15-71b1e421f6e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:29.454010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a32e2e-8b71-4476-9a15-71b1e421f6e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:29.455379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a32e2e-8b71-4476-9a15-71b1e421f6e6 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:29.456763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b7b34-d893-4330-955f-7342d58c434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:29.458024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7b34-d893-4330-955f-7342d58c434e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.458457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7b34-d893-4330-955f-7342d58c434e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.458874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b7b34-d893-4330-955f-7342d58c434e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.459869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b7b34-d893-4330-955f-7342d58c434e None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=95029e6140de425e86b5f9d7e2923bb0) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:29.460358 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b7b34-d893-4330-955f-7342d58c434e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:29.462392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b7b34-d893-4330-955f-7342d58c434e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:29.466506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 337/682] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:29.467305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a32e2e-8b71-4476-9a15-71b1e421f6e6 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:29.484862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 346/683] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:29 2022] GET /identity/v3/role_assignments?user.id=95029e6140de425e86b5f9d7e2923bb0&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:29.484862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b7b34-d893-4330-955f-7342d58c434e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:29.594963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a32e2e-8b71-4476-9a15-71b1e421f6e6 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:29.603831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b7b34-d893-4330-955f-7342d58c434e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:29.641233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cb3a9-4315-470c-8377-f6e3e6d42cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:29.641661 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ee495-c954-4edc-9494-e93b160f0554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:29.642072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cb3a9-4315-470c-8377-f6e3e6d42cef None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.642331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ee495-c954-4edc-9494-e93b160f0554 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.642455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cb3a9-4315-470c-8377-f6e3e6d42cef None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.642610 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ee495-c954-4edc-9494-e93b160f0554 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.642700 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cb3a9-4315-470c-8377-f6e3e6d42cef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.642883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ee495-c954-4edc-9494-e93b160f0554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.643733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ee495-c954-4edc-9494-e93b160f0554 None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=1b14c0c2f0cd4459915dbbe3b5939159) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:29.644045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ee495-c954-4edc-9494-e93b160f0554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:29.645524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ee495-c954-4edc-9494-e93b160f0554 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:29.653106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 338/684] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:29 2022] GET /identity/v3/role_assignments?user.id=1b14c0c2f0cd4459915dbbe3b5939159&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:29.653106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ee495-c954-4edc-9494-e93b160f0554 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:29.682025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cb3a9-4315-470c-8377-f6e3e6d42cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-797cb3a9-4315-470c-8377-f6e3e6d42cef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:29.690463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:29.691446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:29.692820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 347/685] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:29.700311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cb3a9-4315-470c-8377-f6e3e6d42cef None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:29.800141 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ee495-c954-4edc-9494-e93b160f0554 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:29.838466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2956879-639d-4474-a679-ac138db152c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:29.839559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2956879-639d-4474-a679-ac138db152c9 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.840000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2956879-639d-4474-a679-ac138db152c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.840459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2956879-639d-4474-a679-ac138db152c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.840732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cb3a9-4315-470c-8377-f6e3e6d42cef None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:29.851505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2956879-639d-4474-a679-ac138db152c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:29.853233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2956879-639d-4474-a679-ac138db152c9 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-a2956879-639d-4474-a679-ac138db152c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:29.869849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:29.870848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:29.871760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:29.871760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:29.871760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:29.871760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:29.871760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:29.871760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:29.871760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:29.871760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:29.871760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:29.871760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:29.874765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 339/686] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:29.879905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2956879-639d-4474-a679-ac138db152c9 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:29.881914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6b2e2-45fd-4ba1-9658-b4eafe20c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:29.882591 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6b2e2-45fd-4ba1-9658-b4eafe20c54b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:29.882931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6b2e2-45fd-4ba1-9658-b4eafe20c54b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:29.883212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6b2e2-45fd-4ba1-9658-b4eafe20c54b None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:29.883969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6b2e2-45fd-4ba1-9658-b4eafe20c54b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:29.884419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6b2e2-45fd-4ba1-9658-b4eafe20c54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:29.885798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6b2e2-45fd-4ba1-9658-b4eafe20c54b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:29.894546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 348/687] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:29.901471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6b2e2-45fd-4ba1-9658-b4eafe20c54b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:29.990930 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2956879-639d-4474-a679-ac138db152c9 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:30.028492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ae081-2324-4ad1-8f13-fad174cf529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:30.029486 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ae081-2324-4ad1-8f13-fad174cf529d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:30.029948 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ae081-2324-4ad1-8f13-fad174cf529d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:30.030258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6b2e2-45fd-4ba1-9658-b4eafe20c54b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:30.030657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ae081-2324-4ad1-8f13-fad174cf529d None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:30.031682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ae081-2324-4ad1-8f13-fad174cf529d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:30.032217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ae081-2324-4ad1-8f13-fad174cf529d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:30.033861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ae081-2324-4ad1-8f13-fad174cf529d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:30.054816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 340/688] 10.222.0.58 () {56 vars in 1135 bytes} [Tue May 17 11:53:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:30.062790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ae081-2324-4ad1-8f13-fad174cf529d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:30.072988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fd43f-3e73-43d7-8200-845ea9d59051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:30.074136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd43f-3e73-43d7-8200-845ea9d59051 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:30.074433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd43f-3e73-43d7-8200-845ea9d59051 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:30.074713 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd43f-3e73-43d7-8200-845ea9d59051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:30.088056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fd43f-3e73-43d7-8200-845ea9d59051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:30.090276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fd43f-3e73-43d7-8200-845ea9d59051 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-ba0fd43f-3e73-43d7-8200-845ea9d59051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:30.112228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:30.113160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:30.114053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:30.114053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:30.114053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:30.114053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:30.114053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 349/689] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:30.120068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fd43f-3e73-43d7-8200-845ea9d59051 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:30.178059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ae081-2324-4ad1-8f13-fad174cf529d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:30.221335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d74e-39dd-41db-b259-bcf785c84927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:30.221996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d74e-39dd-41db-b259-bcf785c84927 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:30.222278 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d74e-39dd-41db-b259-bcf785c84927 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:30.222552 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3d74e-39dd-41db-b259-bcf785c84927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:30.241161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fd43f-3e73-43d7-8200-845ea9d59051 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:30.307595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b15eb-76f3-490f-a2eb-356779689500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:30.308373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b15eb-76f3-490f-a2eb-356779689500 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:30.308581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b15eb-76f3-490f-a2eb-356779689500 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:30.308831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b15eb-76f3-490f-a2eb-356779689500 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:30.309558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b15eb-76f3-490f-a2eb-356779689500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:30.309863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b15eb-76f3-490f-a2eb-356779689500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:30.312024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b15eb-76f3-490f-a2eb-356779689500 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:30.341346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 350/690] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:30.347439 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b15eb-76f3-490f-a2eb-356779689500 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:30.353621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3d74e-39dd-41db-b259-bcf785c84927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:30.355103 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3d74e-39dd-41db-b259-bcf785c84927 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:30.455510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 341/691] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 11:53:30.461513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d74e-39dd-41db-b259-bcf785c84927 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:30.586534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3d74e-39dd-41db-b259-bcf785c84927 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:30.622348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b15eb-76f3-490f-a2eb-356779689500 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:30.625717 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271fd57-c75d-4c42-94d4-a8e96c3da2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:30.626515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271fd57-c75d-4c42-94d4-a8e96c3da2ad None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:30.626798 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271fd57-c75d-4c42-94d4-a8e96c3da2ad None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:30.627072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271fd57-c75d-4c42-94d4-a8e96c3da2ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:30.638900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271fd57-c75d-4c42-94d4-a8e96c3da2ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:30.641001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271fd57-c75d-4c42-94d4-a8e96c3da2ad None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-c271fd57-c75d-4c42-94d4-a8e96c3da2ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:30.660634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:30.662691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:30.664489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:30.664489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:30.664489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:30.664489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:30.664489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 342/692] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:30.670134 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271fd57-c75d-4c42-94d4-a8e96c3da2ad None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:30.699408 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff4310-ef9d-4e0a-8d0e-3c4f26a33f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:30.700571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff4310-ef9d-4e0a-8d0e-3c4f26a33f6a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:30.701039 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff4310-ef9d-4e0a-8d0e-3c4f26a33f6a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:30.701493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff4310-ef9d-4e0a-8d0e-3c4f26a33f6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:30.709634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff4310-ef9d-4e0a-8d0e-3c4f26a33f6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:30.711303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff4310-ef9d-4e0a-8d0e-3c4f26a33f6a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-3dff4310-ef9d-4e0a-8d0e-3c4f26a33f6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:30.726976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:30.727926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:30.728886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:30.728886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:30.728886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:30.728886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:30.728886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:30.728886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:30.728886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:30.728886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:30.728886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:30.728886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:30.731443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 351/693] 10.222.0.58 () {56 vars in 1093 bytes} [Tue May 17 11:53:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:30.732920 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57103f6-9b64-4071-a27f-d254181750ba None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:30.734034 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57103f6-9b64-4071-a27f-d254181750ba None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:30.734641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57103f6-9b64-4071-a27f-d254181750ba None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:30.740495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 352/694] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:30.741948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc713b-182e-4ce6-8955-bf9eb146be88 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:30.742436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc713b-182e-4ce6-8955-bf9eb146be88 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:30.742910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc713b-182e-4ce6-8955-bf9eb146be88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:30.765813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-fedc713b-182e-4ce6-8955-bf9eb146be88 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:30.767005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-fedc713b-182e-4ce6-8955-bf9eb146be88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:30.779554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271fd57-c75d-4c42-94d4-a8e96c3da2ad None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:30.818939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62e783-7b04-4fb8-8706-85aa3c781e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:30.819613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e783-7b04-4fb8-8706-85aa3c781e97 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:30.819929 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e783-7b04-4fb8-8706-85aa3c781e97 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:30.820552 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e783-7b04-4fb8-8706-85aa3c781e97 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:30.821289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62e783-7b04-4fb8-8706-85aa3c781e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:30.821601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62e783-7b04-4fb8-8706-85aa3c781e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:30.823710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62e783-7b04-4fb8-8706-85aa3c781e97 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:30.840330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 343/695] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:30.841558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62e783-7b04-4fb8-8706-85aa3c781e97 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:30.856344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 353/696] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:30.857554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc713b-182e-4ce6-8955-bf9eb146be88 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:30.960805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc713b-182e-4ce6-8955-bf9eb146be88 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:30.975009 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62e783-7b04-4fb8-8706-85aa3c781e97 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:31.009966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dde7be-7b67-493f-8046-24e11149b138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:31.010177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89433c7-d8de-4816-9134-f5543c04c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:31.010639 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dde7be-7b67-493f-8046-24e11149b138 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:31.010924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dde7be-7b67-493f-8046-24e11149b138 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:31.011201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dde7be-7b67-493f-8046-24e11149b138 None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:31.011879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89433c7-d8de-4816-9134-f5543c04c24b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:31.012051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dde7be-7b67-493f-8046-24e11149b138 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:31.012397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dde7be-7b67-493f-8046-24e11149b138 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:31.012758 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89433c7-d8de-4816-9134-f5543c04c24b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:31.013222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89433c7-d8de-4816-9134-f5543c04c24b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:31.013828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dde7be-7b67-493f-8046-24e11149b138 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:31.023181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89433c7-d8de-4816-9134-f5543c04c24b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:31.025786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89433c7-d8de-4816-9134-f5543c04c24b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:31.037702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 344/697] 10.222.0.58 () {56 vars in 1133 bytes} [Tue May 17 11:53:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:31.038592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dde7be-7b67-493f-8046-24e11149b138 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-a89433c7-d8de-4816-9134-f5543c04c24b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:31.043106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:31.043959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:31.044903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:31.044903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:31.044903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:31.044903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:31.044903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:31.044903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:31.044903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:31.044903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:31.048084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 354/698] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:31.049545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89433c7-d8de-4816-9134-f5543c04c24b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:31.141834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dde7be-7b67-493f-8046-24e11149b138 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:31.177207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89433c7-d8de-4816-9134-f5543c04c24b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:31.180120 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a02d62-a0a9-4ce6-b96c-706917f52342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:31.181266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a02d62-a0a9-4ce6-b96c-706917f52342 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:31.181748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a02d62-a0a9-4ce6-b96c-706917f52342 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:31.182222 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a02d62-a0a9-4ce6-b96c-706917f52342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:31.196079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a02d62-a0a9-4ce6-b96c-706917f52342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:31.198249 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a02d62-a0a9-4ce6-b96c-706917f52342 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:31.210940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d957-c60b-42bf-9b0e-1e3950e20daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:31.211638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d957-c60b-42bf-9b0e-1e3950e20daf None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:31.211998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d957-c60b-42bf-9b0e-1e3950e20daf None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:31.212420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d957-c60b-42bf-9b0e-1e3950e20daf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-46a02d62-a0a9-4ce6-b96c-706917f52342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:31.222348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:31.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:31.224070 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:31.224070 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:31.224070 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:31.224070 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:31.224070 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 345/699] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:31.225189 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a02d62-a0a9-4ce6-b96c-706917f52342 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:31.297227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195d957-c60b-42bf-9b0e-1e3950e20daf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:31.299246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195d957-c60b-42bf-9b0e-1e3950e20daf None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:31.330330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a02d62-a0a9-4ce6-b96c-706917f52342 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:31.369528 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348c7f1-a63e-4277-ac8e-3c6482119995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:31.370187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c7f1-a63e-4277-ac8e-3c6482119995 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:31.370461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c7f1-a63e-4277-ac8e-3c6482119995 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:31.370736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348c7f1-a63e-4277-ac8e-3c6482119995 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:31.371524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348c7f1-a63e-4277-ac8e-3c6482119995 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:31.371836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348c7f1-a63e-4277-ac8e-3c6482119995 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:31.373343 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348c7f1-a63e-4277-ac8e-3c6482119995 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:31.386449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 346/700] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:31.387336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348c7f1-a63e-4277-ac8e-3c6482119995 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:31.418631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 355/701] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:31.424649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d957-c60b-42bf-9b0e-1e3950e20daf None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:31.521501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348c7f1-a63e-4277-ac8e-3c6482119995 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:31.529639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d957-c60b-42bf-9b0e-1e3950e20daf None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:31.563877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe436c2-ec75-4402-ac62-63d5ef76f8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:31.564576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe436c2-ec75-4402-ac62-63d5ef76f8f7 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:31.564878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe436c2-ec75-4402-ac62-63d5ef76f8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:31.565341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe436c2-ec75-4402-ac62-63d5ef76f8f7 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:31.565872 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe436c2-ec75-4402-ac62-63d5ef76f8f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:31.566182 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe436c2-ec75-4402-ac62-63d5ef76f8f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:31.567548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe436c2-ec75-4402-ac62-63d5ef76f8f7 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:31.578666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374b763-8b00-4569-bbeb-307d90145fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:31.579623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374b763-8b00-4569-bbeb-307d90145fd5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:31.580107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374b763-8b00-4569-bbeb-307d90145fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:31.580233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 347/702] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:31.580721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374b763-8b00-4569-bbeb-307d90145fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:31.581175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe436c2-ec75-4402-ac62-63d5ef76f8f7 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:31.582091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374b763-8b00-4569-bbeb-307d90145fd5 None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=5206e8bbb04042f4b00637518f297a97) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:31.582605 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374b763-8b00-4569-bbeb-307d90145fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:31.585578 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374b763-8b00-4569-bbeb-307d90145fd5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:31.593475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 356/703] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:31 2022] GET /identity/v3/role_assignments?user.id=5206e8bbb04042f4b00637518f297a97&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:31.594868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374b763-8b00-4569-bbeb-307d90145fd5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:31.689727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe436c2-ec75-4402-ac62-63d5ef76f8f7 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:31.705915 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374b763-8b00-4569-bbeb-307d90145fd5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:31.728347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46ed93-a59c-482d-b045-604c2e0bfc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:31.729541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46ed93-a59c-482d-b045-604c2e0bfc3a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:31.730059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46ed93-a59c-482d-b045-604c2e0bfc3a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:31.730535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46ed93-a59c-482d-b045-604c2e0bfc3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:31.742496 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46ed93-a59c-482d-b045-604c2e0bfc3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:31.743311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daabb9-80f8-410c-9802-9e0ba1a9781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:31.743998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daabb9-80f8-410c-9802-9e0ba1a9781d None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:31.744312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daabb9-80f8-410c-9802-9e0ba1a9781d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:31.744596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daabb9-80f8-410c-9802-9e0ba1a9781d None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:31.745255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46ed93-a59c-482d-b045-604c2e0bfc3a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:31.745360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3daabb9-80f8-410c-9802-9e0ba1a9781d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:31.746783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3daabb9-80f8-410c-9802-9e0ba1a9781d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-ad46ed93-a59c-482d-b045-604c2e0bfc3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:31.765778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:31.766833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:31.767702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:31.767702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:31.767702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:31.767702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:31.770006 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 348/704] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:31.775393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 357/705] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:53:31 2022] POST /identity/v3/users => generated 254 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:53:31.777021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46ed93-a59c-482d-b045-604c2e0bfc3a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:31.912589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46ed93-a59c-482d-b045-604c2e0bfc3a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:31.950968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ce30-77ea-408a-970e-846101415624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:31.951643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ce30-77ea-408a-970e-846101415624 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:31.951922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ce30-77ea-408a-970e-846101415624 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:31.952364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ce30-77ea-408a-970e-846101415624 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:31.953107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ce30-77ea-408a-970e-846101415624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:31.953469 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ce30-77ea-408a-970e-846101415624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:31.954917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ce30-77ea-408a-970e-846101415624 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:31.969117 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 349/706] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:31.974554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daabb9-80f8-410c-9802-9e0ba1a9781d None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:32.094542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daabb9-80f8-410c-9802-9e0ba1a9781d None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:32.130051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa567d0-133c-4206-9aaf-71545f20b0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:32.130856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa567d0-133c-4206-9aaf-71545f20b0ed None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:32.131146 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa567d0-133c-4206-9aaf-71545f20b0ed None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:32.131411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa567d0-133c-4206-9aaf-71545f20b0ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:32.138603 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa567d0-133c-4206-9aaf-71545f20b0ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:32.140754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa567d0-133c-4206-9aaf-71545f20b0ed None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-afa567d0-133c-4206-9aaf-71545f20b0ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:32.156519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:32.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:32.158298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:32.158298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:32.158298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:32.158298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:32.158298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:32.158298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:32.158298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:32.158298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:32.159051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 358/707] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:32.163823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ce30-77ea-408a-970e-846101415624 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:32.215407 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046efcbf-303e-4118-bcf9-144abf5f0008 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:32.215718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046efcbf-303e-4118-bcf9-144abf5f0008 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:32.215964 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046efcbf-303e-4118-bcf9-144abf5f0008 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:32.217990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 359/708] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:32.224048 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19c37f-0c03-4433-9742-db070e55e08d None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:32.224992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19c37f-0c03-4433-9742-db070e55e08d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:32.225487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19c37f-0c03-4433-9742-db070e55e08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:32.256283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-4e19c37f-0c03-4433-9742-db070e55e08d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:32.257525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4e19c37f-0c03-4433-9742-db070e55e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:32.341027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ce30-77ea-408a-970e-846101415624 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:32.390251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 360/709] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:53:32.395194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71336-e9ec-475b-9cf5-70235ddd9cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:32.395938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71336-e9ec-475b-9cf5-70235ddd9cbd None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:32.396322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71336-e9ec-475b-9cf5-70235ddd9cbd None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:32.396664 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f71336-e9ec-475b-9cf5-70235ddd9cbd None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:32.397530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f71336-e9ec-475b-9cf5-70235ddd9cbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:32.397907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f71336-e9ec-475b-9cf5-70235ddd9cbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:32.399410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f71336-e9ec-475b-9cf5-70235ddd9cbd None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:32.412954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 350/710] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:32.421976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19c37f-0c03-4433-9742-db070e55e08d None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:32.430733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71336-e9ec-475b-9cf5-70235ddd9cbd None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:32.538706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19c37f-0c03-4433-9742-db070e55e08d None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:32.568945 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f71336-e9ec-475b-9cf5-70235ddd9cbd None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:32.573640 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93a09a-29a7-41fb-a3fa-7c68c2480620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:32.574518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a09a-29a7-41fb-a3fa-7c68c2480620 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:32.574971 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a09a-29a7-41fb-a3fa-7c68c2480620 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:32.575411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a09a-29a7-41fb-a3fa-7c68c2480620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:32.576484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93a09a-29a7-41fb-a3fa-7c68c2480620 None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=d86479ff40f54e7793f1771cb6ad362a) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:32.577043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93a09a-29a7-41fb-a3fa-7c68c2480620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:32.579170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93a09a-29a7-41fb-a3fa-7c68c2480620 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:32.585419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 361/711] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:32 2022] GET /identity/v3/role_assignments?user.id=d86479ff40f54e7793f1771cb6ad362a&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=3db33dfd3d6544fd81933007633fc56a => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:32.586960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d0ee-3e3e-45db-990f-65bc53a39fee None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:32.587446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d0ee-3e3e-45db-990f-65bc53a39fee None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:32.587939 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4d0ee-3e3e-45db-990f-65bc53a39fee None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:32.589786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 362/712] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:32.601845 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51872cc-9aae-4864-8584-97f543bcb4cc None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:32.602182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51872cc-9aae-4864-8584-97f543bcb4cc None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:32.602395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51872cc-9aae-4864-8584-97f543bcb4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:32.627038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9ef80-f530-4dfc-80cb-83b88fc4bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:32.636239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f51872cc-9aae-4864-8584-97f543bcb4cc None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:32.636239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f51872cc-9aae-4864-8584-97f543bcb4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:32.636497 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ef80-f530-4dfc-80cb-83b88fc4bb61 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:32.636744 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ef80-f530-4dfc-80cb-83b88fc4bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:32.637027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ef80-f530-4dfc-80cb-83b88fc4bb61 None admin] PATH_INFO: `/v3/services/network` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:32.637743 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9ef80-f530-4dfc-80cb-83b88fc4bb61 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:32.639176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9ef80-f530-4dfc-80cb-83b88fc4bb61 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-6fe9ef80-f530-4dfc-80cb-83b88fc4bb61 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:32.669316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:32.670381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:32.671334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 351/713] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:32 2022] GET /identity/v3/services/network => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:32.677119 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9ef80-f530-4dfc-80cb-83b88fc4bb61 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:32.747252 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 363/714] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:32.781575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51872cc-9aae-4864-8584-97f543bcb4cc None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:32.822138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9ef80-f530-4dfc-80cb-83b88fc4bb61 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:32.875407 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc0fb8-c9c4-4787-9464-797f23f08343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:32.876083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc0fb8-c9c4-4787-9464-797f23f08343 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:32.876377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc0fb8-c9c4-4787-9464-797f23f08343 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:32.876657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc0fb8-c9c4-4787-9464-797f23f08343 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:32.877352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc0fb8-c9c4-4787-9464-797f23f08343 None admin] RBAC: Adding query filter params (name=network) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:32.877653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc0fb8-c9c4-4787-9464-797f23f08343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:32.879016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc0fb8-c9c4-4787-9464-797f23f08343 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:32.891089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 352/715] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:53:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:32.909028 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc0fb8-c9c4-4787-9464-797f23f08343 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:32.918508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51872cc-9aae-4864-8584-97f543bcb4cc None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:32.980159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbffaed-97e7-4de1-9212-be9887c08706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:32.981387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffaed-97e7-4de1-9212-be9887c08706 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:32.981869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffaed-97e7-4de1-9212-be9887c08706 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:32.982350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffaed-97e7-4de1-9212-be9887c08706 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:32.984155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbffaed-97e7-4de1-9212-be9887c08706 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:32.986728 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbffaed-97e7-4de1-9212-be9887c08706 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-4fbffaed-97e7-4de1-9212-be9887c08706 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:33.013457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:33.015810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:33.017231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 364/716] 10.222.0.58 () {56 vars in 1129 bytes} [Tue May 17 11:53:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:33.022185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbffaed-97e7-4de1-9212-be9887c08706 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:33.136420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbffaed-97e7-4de1-9212-be9887c08706 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:33.171852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc0fb8-c9c4-4787-9464-797f23f08343 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:33.185963 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0740a-173c-46a8-8997-c61efdcd616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:33.187103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0740a-173c-46a8-8997-c61efdcd616a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:33.187588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0740a-173c-46a8-8997-c61efdcd616a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:33.188061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0740a-173c-46a8-8997-c61efdcd616a None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:33.188997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0740a-173c-46a8-8997-c61efdcd616a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:33.189504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0740a-173c-46a8-8997-c61efdcd616a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:33.191130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0740a-173c-46a8-8997-c61efdcd616a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:33.202548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 365/717] 10.222.0.58 () {56 vars in 1124 bytes} [Tue May 17 11:53:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:33.208234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0740a-173c-46a8-8997-c61efdcd616a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:33.231108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193ca8f-9f68-4dbe-b141-1bbe05cd983b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:33.232170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193ca8f-9f68-4dbe-b141-1bbe05cd983b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:33.232695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193ca8f-9f68-4dbe-b141-1bbe05cd983b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:33.233203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193ca8f-9f68-4dbe-b141-1bbe05cd983b None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:33.234861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193ca8f-9f68-4dbe-b141-1bbe05cd983b None admin] RBAC: Adding query filter params (type=network) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:33.235380 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193ca8f-9f68-4dbe-b141-1bbe05cd983b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:33.237400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193ca8f-9f68-4dbe-b141-1bbe05cd983b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:33.243791 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 353/718] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:53:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:33.338724 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0740a-173c-46a8-8997-c61efdcd616a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:33.374822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67155c6-f285-469e-bb59-61710a2e3a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:33.375891 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67155c6-f285-469e-bb59-61710a2e3a17 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:33.376406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67155c6-f285-469e-bb59-61710a2e3a17 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:33.376919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67155c6-f285-469e-bb59-61710a2e3a17 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:33.377871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67155c6-f285-469e-bb59-61710a2e3a17 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:33.378393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67155c6-f285-469e-bb59-61710a2e3a17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:33.380084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67155c6-f285-469e-bb59-61710a2e3a17 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:33.387112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 366/719] 10.222.0.58 () {56 vars in 1124 bytes} [Tue May 17 11:53:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:34.551150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5856363-d06a-4587-83e7-770ed4b64b58 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:34.551657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5856363-d06a-4587-83e7-770ed4b64b58 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:34.551756 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5856363-d06a-4587-83e7-770ed4b64b58 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:34.553321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 354/720] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:34.558835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d750b-edb5-46e9-b6dc-ed121c446fae None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:34.559252 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d750b-edb5-46e9-b6dc-ed121c446fae None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:34.559423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d750b-edb5-46e9-b6dc-ed121c446fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:34.588318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a52d750b-edb5-46e9-b6dc-ed121c446fae None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:34.589513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a52d750b-edb5-46e9-b6dc-ed121c446fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:34.686263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 367/721] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:53:34.721512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5856363-d06a-4587-83e7-770ed4b64b58 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:34.849312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5856363-d06a-4587-83e7-770ed4b64b58 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:34.889245 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ba50-21d2-440e-9afb-bc77f01c4134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:34.890070 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ba50-21d2-440e-9afb-bc77f01c4134 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:34.890414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ba50-21d2-440e-9afb-bc77f01c4134 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:34.890611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ba50-21d2-440e-9afb-bc77f01c4134 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:34.905766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81ba50-21d2-440e-9afb-bc77f01c4134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-1b81ba50-21d2-440e-9afb-bc77f01c4134 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:34.913382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:34.914362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:34.916167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 355/722] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:34.920513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d750b-edb5-46e9-b6dc-ed121c446fae None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:34.924625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c14fb9-6016-44fe-bcb3-b11a914933d7 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:34.924912 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c14fb9-6016-44fe-bcb3-b11a914933d7 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:34.925191 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c14fb9-6016-44fe-bcb3-b11a914933d7 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:34.926773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 356/723] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:34.931597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970816f-acf5-4b6b-a216-0b57964fa203 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:34.931881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970816f-acf5-4b6b-a216-0b57964fa203 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:34.932159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970816f-acf5-4b6b-a216-0b57964fa203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:34.953431 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-9970816f-acf5-4b6b-a216-0b57964fa203 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:34.954599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9970816f-acf5-4b6b-a216-0b57964fa203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:35.072167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 357/724] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 11:53:35.096876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970816f-acf5-4b6b-a216-0b57964fa203 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:35.110117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d750b-edb5-46e9-b6dc-ed121c446fae None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:35.179930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f976e1c-1ad5-4749-873d-64deaeb3aa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:35.180644 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f976e1c-1ad5-4749-873d-64deaeb3aa85 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.180923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f976e1c-1ad5-4749-873d-64deaeb3aa85 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.181194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f976e1c-1ad5-4749-873d-64deaeb3aa85 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.181959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f976e1c-1ad5-4749-873d-64deaeb3aa85 None admin] RBAC: Adding query filter params (name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:35.182262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f976e1c-1ad5-4749-873d-64deaeb3aa85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:35.183686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f976e1c-1ad5-4749-873d-64deaeb3aa85 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:35.204387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 368/725] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:35.208422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f976e1c-1ad5-4749-873d-64deaeb3aa85 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:35.272076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970816f-acf5-4b6b-a216-0b57964fa203 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:35.310943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccda56-f754-4e5d-8a28-f26f614ca5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:35.312529 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccda56-f754-4e5d-8a28-f26f614ca5cc None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.312804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccda56-f754-4e5d-8a28-f26f614ca5cc None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.313071 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccda56-f754-4e5d-8a28-f26f614ca5cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.332257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccda56-f754-4e5d-8a28-f26f614ca5cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-01ccda56-f754-4e5d-8a28-f26f614ca5cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:35.339811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:35.340740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:35.341561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:35.349545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 358/726] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:35.358966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccda56-f754-4e5d-8a28-f26f614ca5cc None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:35.389447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f976e1c-1ad5-4749-873d-64deaeb3aa85 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:35.423277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed981f58-40ac-4d67-b461-fdce7e7e84b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:35.424074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed981f58-40ac-4d67-b461-fdce7e7e84b6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.424416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed981f58-40ac-4d67-b461-fdce7e7e84b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.424705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed981f58-40ac-4d67-b461-fdce7e7e84b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.435168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed981f58-40ac-4d67-b461-fdce7e7e84b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:35.437646 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed981f58-40ac-4d67-b461-fdce7e7e84b6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-ed981f58-40ac-4d67-b461-fdce7e7e84b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:35.455512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:35.457826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:35.459396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:35.459396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:35.459396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:35.459396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:35.459396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 369/727] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:35.459396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa80a96-2b62-4432-807c-cdb5422e289a None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.459396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa80a96-2b62-4432-807c-cdb5422e289a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.459396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa80a96-2b62-4432-807c-cdb5422e289a None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.460564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 370/728] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:35.464227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa80a96-2b62-4432-807c-cdb5422e289a None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:35.469893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccda56-f754-4e5d-8a28-f26f614ca5cc None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:35.504217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665636e1-b569-49b4-ac42-2188cbbacbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:35.504895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665636e1-b569-49b4-ac42-2188cbbacbdd None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.505177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665636e1-b569-49b4-ac42-2188cbbacbdd None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.505451 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665636e1-b569-49b4-ac42-2188cbbacbdd None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.506193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665636e1-b569-49b4-ac42-2188cbbacbdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:35.506498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665636e1-b569-49b4-ac42-2188cbbacbdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:35.507868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665636e1-b569-49b4-ac42-2188cbbacbdd None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:35.521321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 359/729] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:35.521321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d777b6-966d-4bd0-bee2-d792c3cb18f0 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.521321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d777b6-966d-4bd0-bee2-d792c3cb18f0 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.521321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d777b6-966d-4bd0-bee2-d792c3cb18f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.539066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-59d777b6-966d-4bd0-bee2-d792c3cb18f0 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:35.540408 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-59d777b6-966d-4bd0-bee2-d792c3cb18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:35.574512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa80a96-2b62-4432-807c-cdb5422e289a None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:35.609229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88451f8f-7804-41a7-8576-01f2b43762f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:35.610394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88451f8f-7804-41a7-8576-01f2b43762f0 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.610874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88451f8f-7804-41a7-8576-01f2b43762f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.611374 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88451f8f-7804-41a7-8576-01f2b43762f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.612317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88451f8f-7804-41a7-8576-01f2b43762f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:35.612906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88451f8f-7804-41a7-8576-01f2b43762f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:35.614721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88451f8f-7804-41a7-8576-01f2b43762f0 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:35.616424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 360/730] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:35.617366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d777b6-966d-4bd0-bee2-d792c3cb18f0 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:35.629343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 371/731] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:35.635207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88451f8f-7804-41a7-8576-01f2b43762f0 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:35.740346 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d777b6-966d-4bd0-bee2-d792c3cb18f0 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:35.740798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88451f8f-7804-41a7-8576-01f2b43762f0 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:35.775906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fca44-48dc-42eb-a2cb-1ce8e87fb737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:35.776986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fca44-48dc-42eb-a2cb-1ce8e87fb737 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.777128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff1c18-357d-46ed-827d-feaf993914f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:35.777546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fca44-48dc-42eb-a2cb-1ce8e87fb737 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.777962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fca44-48dc-42eb-a2cb-1ce8e87fb737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.778071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1c18-357d-46ed-827d-feaf993914f1 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.778422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1c18-357d-46ed-827d-feaf993914f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.778767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1c18-357d-46ed-827d-feaf993914f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.787165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff1c18-357d-46ed-827d-feaf993914f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:35.788744 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff1c18-357d-46ed-827d-feaf993914f1 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:35.790157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fca44-48dc-42eb-a2cb-1ce8e87fb737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:35.791799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fca44-48dc-42eb-a2cb-1ce8e87fb737 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-35ff1c18-357d-46ed-827d-feaf993914f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:35.805127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:35.806234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:35.807162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:35.807162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:35.807162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:35.807162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:35.807162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:35.807162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:35.807162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:35.807162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:35.807162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:53:35.807162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:35.812520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 372/732] 10.222.0.58 () {56 vars in 1117 bytes} [Tue May 17 11:53:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:35.813515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff1c18-357d-46ed-827d-feaf993914f1 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-657fca44-48dc-42eb-a2cb-1ce8e87fb737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:35.814272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:35.815274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:35.816307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:35.816307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:35.816307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:35.816307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:35.818066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 361/733] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:35.819050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fca44-48dc-42eb-a2cb-1ce8e87fb737 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:35.916351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff1c18-357d-46ed-827d-feaf993914f1 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:35.923165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fca44-48dc-42eb-a2cb-1ce8e87fb737 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:35.950065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e26dce-15bd-461e-a409-fa6075f7cf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:35.950825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e26dce-15bd-461e-a409-fa6075f7cf24 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.951105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e26dce-15bd-461e-a409-fa6075f7cf24 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.951373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e26dce-15bd-461e-a409-fa6075f7cf24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.958742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3147fc-ddd2-4b4d-bb6d-9ac65e975934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:35.959665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3147fc-ddd2-4b4d-bb6d-9ac65e975934 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.960201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3147fc-ddd2-4b4d-bb6d-9ac65e975934 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.960663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3147fc-ddd2-4b4d-bb6d-9ac65e975934 None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.961578 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e26dce-15bd-461e-a409-fa6075f7cf24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:35.961898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3147fc-ddd2-4b4d-bb6d-9ac65e975934 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:35.962386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3147fc-ddd2-4b4d-bb6d-9ac65e975934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:35.963985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3147fc-ddd2-4b4d-bb6d-9ac65e975934 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-56e26dce-15bd-461e-a409-fa6075f7cf24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:35.969655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:35.970562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:35.971455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 373/734] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:35.972444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e26dce-15bd-461e-a409-fa6075f7cf24 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:35.991958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 362/735] 10.222.0.58 () {56 vars in 1149 bytes} [Tue May 17 11:53:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:35.991958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ec196-7dc6-4a63-ba4e-7d78bec13767 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:35.991958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ec196-7dc6-4a63-ba4e-7d78bec13767 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:35.991958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ec196-7dc6-4a63-ba4e-7d78bec13767 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:35.991958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 363/736] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:35.991958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ec196-7dc6-4a63-ba4e-7d78bec13767 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:36.081478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e26dce-15bd-461e-a409-fa6075f7cf24 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:36.105901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ec196-7dc6-4a63-ba4e-7d78bec13767 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:36.118133 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773b18-52ef-488f-92b1-f67dcd9e093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:36.118879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773b18-52ef-488f-92b1-f67dcd9e093f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:36.119170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773b18-52ef-488f-92b1-f67dcd9e093f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:36.119445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773b18-52ef-488f-92b1-f67dcd9e093f None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:36.120307 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773b18-52ef-488f-92b1-f67dcd9e093f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:36.120624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773b18-52ef-488f-92b1-f67dcd9e093f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:36.122115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773b18-52ef-488f-92b1-f67dcd9e093f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:36.141031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 374/737] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:36.141911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773b18-52ef-488f-92b1-f67dcd9e093f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:36.244813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773b18-52ef-488f-92b1-f67dcd9e093f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:36.262498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53b84e-a0d0-4f58-a5e0-59b5135fe74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:36.263174 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53b84e-a0d0-4f58-a5e0-59b5135fe74d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:36.263456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53b84e-a0d0-4f58-a5e0-59b5135fe74d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:36.263730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53b84e-a0d0-4f58-a5e0-59b5135fe74d None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:36.264544 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53b84e-a0d0-4f58-a5e0-59b5135fe74d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:36.265208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53b84e-a0d0-4f58-a5e0-59b5135fe74d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:36.266209 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53b84e-a0d0-4f58-a5e0-59b5135fe74d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:36.274336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 364/738] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:36.279038 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f55302-f92a-4a58-9f25-1cdf80752694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:36.279688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f55302-f92a-4a58-9f25-1cdf80752694 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:36.279965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f55302-f92a-4a58-9f25-1cdf80752694 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:36.280611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad862d-431c-4bff-b022-e8ae5413181c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:36.280897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad862d-431c-4bff-b022-e8ae5413181c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:36.281110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f55302-f92a-4a58-9f25-1cdf80752694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:36.281220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad862d-431c-4bff-b022-e8ae5413181c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:36.297381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-93ad862d-431c-4bff-b022-e8ae5413181c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:36.298542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-93ad862d-431c-4bff-b022-e8ae5413181c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:36.344836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f55302-f92a-4a58-9f25-1cdf80752694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:36.346270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f55302-f92a-4a58-9f25-1cdf80752694 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:36.360823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 365/739] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:36.361452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad862d-431c-4bff-b022-e8ae5413181c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:36.453054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad862d-431c-4bff-b022-e8ae5413181c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:36.461523 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 375/740] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:36.462370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f55302-f92a-4a58-9f25-1cdf80752694 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:36.489863 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1ad9f-39be-4615-8045-68b42b19db3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:36.490648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ad9f-39be-4615-8045-68b42b19db3a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:36.490928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ad9f-39be-4615-8045-68b42b19db3a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:36.491203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1ad9f-39be-4615-8045-68b42b19db3a None admin] PATH_INFO: `/v3/users/swift` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:36.498135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1ad9f-39be-4615-8045-68b42b19db3a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:36.500276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1ad9f-39be-4615-8045-68b42b19db3a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-1ee1ad9f-39be-4615-8045-68b42b19db3a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:36.514160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:36.515794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 366/741] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:36.517227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136236d-7c80-4f3d-8eed-6a47e8cd5891 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:36.518038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136236d-7c80-4f3d-8eed-6a47e8cd5891 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:36.518038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136236d-7c80-4f3d-8eed-6a47e8cd5891 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:36.518844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 367/742] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:36.519506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136236d-7c80-4f3d-8eed-6a47e8cd5891 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:36.560066 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f55302-f92a-4a58-9f25-1cdf80752694 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:36.592708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62cb59-a933-4f0a-be3f-78e5b7d4e2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:36.593615 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62cb59-a933-4f0a-be3f-78e5b7d4e2ce None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:36.593896 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62cb59-a933-4f0a-be3f-78e5b7d4e2ce None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:36.594170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62cb59-a933-4f0a-be3f-78e5b7d4e2ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:36.603570 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62cb59-a933-4f0a-be3f-78e5b7d4e2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:36.605037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62cb59-a933-4f0a-be3f-78e5b7d4e2ce None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:36.617205 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136236d-7c80-4f3d-8eed-6a47e8cd5891 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-4a62cb59-a933-4f0a-be3f-78e5b7d4e2ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:36.621574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:36.622449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:36.623391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:36.623391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:36.623391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:36.623391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:36.623391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 376/743] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:36.623685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62cb59-a933-4f0a-be3f-78e5b7d4e2ce None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:36.649946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924fdc4-1e2c-46ad-b224-56ea9962876b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:36.650609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924fdc4-1e2c-46ad-b224-56ea9962876b None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:36.650893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924fdc4-1e2c-46ad-b224-56ea9962876b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:36.651171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924fdc4-1e2c-46ad-b224-56ea9962876b None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:36.651902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924fdc4-1e2c-46ad-b224-56ea9962876b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:36.653274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924fdc4-1e2c-46ad-b224-56ea9962876b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:36.667829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 368/744] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:53:36 2022] POST /identity/v3/services => generated 240 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:53:36.668567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924fdc4-1e2c-46ad-b224-56ea9962876b None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:36.740912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62cb59-a933-4f0a-be3f-78e5b7d4e2ce None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:36.783469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e47c85-5b9e-4f1f-b61d-1424430c604e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:36.784281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e47c85-5b9e-4f1f-b61d-1424430c604e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:36.784564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e47c85-5b9e-4f1f-b61d-1424430c604e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:36.784886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e47c85-5b9e-4f1f-b61d-1424430c604e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:36.786976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924fdc4-1e2c-46ad-b224-56ea9962876b None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:36.796482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e47c85-5b9e-4f1f-b61d-1424430c604e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:36.797968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e47c85-5b9e-4f1f-b61d-1424430c604e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-45e47c85-5b9e-4f1f-b61d-1424430c604e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:36.816932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:36.817940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:36.818797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:36.818797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:36.818797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:36.818797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:36.818797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 377/745] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:36.819569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb0df9-ea56-4382-8f1a-d4f8822dffba None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:36.819821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb0df9-ea56-4382-8f1a-d4f8822dffba None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:36.820098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb0df9-ea56-4382-8f1a-d4f8822dffba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:36.827921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27662ea-1fb0-40d9-aaaa-92edbf062c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:36.828699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27662ea-1fb0-40d9-aaaa-92edbf062c01 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:36.828984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27662ea-1fb0-40d9-aaaa-92edbf062c01 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:36.829256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27662ea-1fb0-40d9-aaaa-92edbf062c01 None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:36.830111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27662ea-1fb0-40d9-aaaa-92edbf062c01 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:36.830418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27662ea-1fb0-40d9-aaaa-92edbf062c01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:36.831870 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27662ea-1fb0-40d9-aaaa-92edbf062c01 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:36.838292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-4efb0df9-ea56-4382-8f1a-d4f8822dffba None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:36.839531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4efb0df9-ea56-4382-8f1a-d4f8822dffba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:36.851087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 369/746] 10.222.0.58 () {56 vars in 1135 bytes} [Tue May 17 11:53:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:36.851699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27662ea-1fb0-40d9-aaaa-92edbf062c01 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:36.911254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 378/747] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:36 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 11:53:36.912098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb0df9-ea56-4382-8f1a-d4f8822dffba None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:36.968910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27662ea-1fb0-40d9-aaaa-92edbf062c01 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:37.002433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999090d-271e-4631-85b2-114867a0a67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:37.003100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999090d-271e-4631-85b2-114867a0a67f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:37.003386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999090d-271e-4631-85b2-114867a0a67f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:37.003666 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999090d-271e-4631-85b2-114867a0a67f None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:37.004422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999090d-271e-4631-85b2-114867a0a67f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:37.004737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999090d-271e-4631-85b2-114867a0a67f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:37.006109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999090d-271e-4631-85b2-114867a0a67f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:37.011206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb0df9-ea56-4382-8f1a-d4f8822dffba None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:37.022303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 370/748] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:37.022303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999090d-271e-4631-85b2-114867a0a67f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:37.049348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fa4ab-a6a0-464e-8c94-b58eeabd4814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:37.049937 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fa4ab-a6a0-464e-8c94-b58eeabd4814 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:37.050221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fa4ab-a6a0-464e-8c94-b58eeabd4814 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:37.050501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fa4ab-a6a0-464e-8c94-b58eeabd4814 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:37.051222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fa4ab-a6a0-464e-8c94-b58eeabd4814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:37.051529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fa4ab-a6a0-464e-8c94-b58eeabd4814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:37.052945 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fa4ab-a6a0-464e-8c94-b58eeabd4814 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:37.069130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 379/749] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:37.069130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fa4ab-a6a0-464e-8c94-b58eeabd4814 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:37.128427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999090d-271e-4631-85b2-114867a0a67f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:37.163484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c322720-423c-47cd-8565-1844387b62f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:37.164140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c322720-423c-47cd-8565-1844387b62f6 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:37.164456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c322720-423c-47cd-8565-1844387b62f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:37.164738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c322720-423c-47cd-8565-1844387b62f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:37.169480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fa4ab-a6a0-464e-8c94-b58eeabd4814 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:37.203061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49545b76-f1e0-4eac-a078-8e4badb8d676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:37.203867 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49545b76-f1e0-4eac-a078-8e4badb8d676 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:37.204148 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49545b76-f1e0-4eac-a078-8e4badb8d676 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:37.204451 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49545b76-f1e0-4eac-a078-8e4badb8d676 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:37.205163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49545b76-f1e0-4eac-a078-8e4badb8d676 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:37.206542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49545b76-f1e0-4eac-a078-8e4badb8d676 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:37.229912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 380/750] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:53:37 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:53:37.229912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49545b76-f1e0-4eac-a078-8e4badb8d676 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:37.259379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c322720-423c-47cd-8565-1844387b62f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:37.261724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c322720-423c-47cd-8565-1844387b62f6 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:37.341115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49545b76-f1e0-4eac-a078-8e4badb8d676 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:37.384166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b9da-d983-4de6-a398-bdd0ae2e3538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:37.385270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b9da-d983-4de6-a398-bdd0ae2e3538 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:37.385552 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b9da-d983-4de6-a398-bdd0ae2e3538 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:37.385825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b9da-d983-4de6-a398-bdd0ae2e3538 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:37.387428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 371/751] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:37 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 11:53:37.388329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c322720-423c-47cd-8565-1844387b62f6 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:37.401201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945b9da-d983-4de6-a398-bdd0ae2e3538 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:37.404284 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945b9da-d983-4de6-a398-bdd0ae2e3538 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-0945b9da-d983-4de6-a398-bdd0ae2e3538 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:37.421811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:37.422783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:37.423682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:37.423682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:37.423682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:37.423682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:37.423682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:37.423682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:37.423682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:37.423682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:37.423682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:37.423682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:37.425494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 381/752] 10.222.0.58 () {56 vars in 1093 bytes} [Tue May 17 11:53:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:37.426461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b9da-d983-4de6-a398-bdd0ae2e3538 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:37.504588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c322720-423c-47cd-8565-1844387b62f6 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:37.548066 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b9da-d983-4de6-a398-bdd0ae2e3538 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:37.552365 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb8224-decb-4b0b-be99-083618e6ff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:37.553257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb8224-decb-4b0b-be99-083618e6ff3f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:37.553654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb8224-decb-4b0b-be99-083618e6ff3f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:37.554021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb8224-decb-4b0b-be99-083618e6ff3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:37.561670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb8224-decb-4b0b-be99-083618e6ff3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:37.563256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb8224-decb-4b0b-be99-083618e6ff3f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-63cb8224-decb-4b0b-be99-083618e6ff3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:37.577457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:37.578518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:37.579593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:37.579593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:37.579593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:37.579593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:37.579593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:37.579593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:37.579593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:37.579593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:37.581432 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 372/753] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:37.582368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb8224-decb-4b0b-be99-083618e6ff3f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:37.588677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a0cd-6358-4996-8227-077a5fa9eaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:37.589747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a0cd-6358-4996-8227-077a5fa9eaf9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:37.590176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a0cd-6358-4996-8227-077a5fa9eaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:37.590660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a0cd-6358-4996-8227-077a5fa9eaf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:37.602418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6a0cd-6358-4996-8227-077a5fa9eaf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:37.604624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6a0cd-6358-4996-8227-077a5fa9eaf9 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-c6b6a0cd-6358-4996-8227-077a5fa9eaf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:37.622022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:37.622933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:37.623832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:37.623832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:37.623832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:37.623832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:37.626119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 382/754] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:37.627075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a0cd-6358-4996-8227-077a5fa9eaf9 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:37.701220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb8224-decb-4b0b-be99-083618e6ff3f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:37.734888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a0cd-6358-4996-8227-077a5fa9eaf9 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:37.737147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a683b86-e9eb-4472-b3f7-efb465aa45b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:37.738019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a683b86-e9eb-4472-b3f7-efb465aa45b8 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:37.738484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a683b86-e9eb-4472-b3f7-efb465aa45b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:37.738960 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a683b86-e9eb-4472-b3f7-efb465aa45b8 None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:37.739980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a683b86-e9eb-4472-b3f7-efb465aa45b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:37.740492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a683b86-e9eb-4472-b3f7-efb465aa45b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:37.742130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a683b86-e9eb-4472-b3f7-efb465aa45b8 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:37.764250 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 373/755] 10.222.0.58 () {56 vars in 1133 bytes} [Tue May 17 11:53:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:37.766074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a683b86-e9eb-4472-b3f7-efb465aa45b8 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:37.771032 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5921db3-b8dc-4ea0-b7c9-1f06397dd004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:37.771769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5921db3-b8dc-4ea0-b7c9-1f06397dd004 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:37.772152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5921db3-b8dc-4ea0-b7c9-1f06397dd004 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:37.772518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5921db3-b8dc-4ea0-b7c9-1f06397dd004 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:37.773373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5921db3-b8dc-4ea0-b7c9-1f06397dd004 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:37.773746 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5921db3-b8dc-4ea0-b7c9-1f06397dd004 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:37.775260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5921db3-b8dc-4ea0-b7c9-1f06397dd004 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:37.788984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 383/756] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:37.790333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5921db3-b8dc-4ea0-b7c9-1f06397dd004 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:37.877195 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a683b86-e9eb-4472-b3f7-efb465aa45b8 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:37.893885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5921db3-b8dc-4ea0-b7c9-1f06397dd004 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:37.911901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f42126-fa57-431d-b704-c560a77f674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:37.912917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f42126-fa57-431d-b704-c560a77f674f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:37.913300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f42126-fa57-431d-b704-c560a77f674f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:37.913675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f42126-fa57-431d-b704-c560a77f674f None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:37.914519 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f42126-fa57-431d-b704-c560a77f674f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:37.914931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f42126-fa57-431d-b704-c560a77f674f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:37.916437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f42126-fa57-431d-b704-c560a77f674f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:37.932108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 374/757] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:37.932108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f42126-fa57-431d-b704-c560a77f674f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:37.939263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c970a-d4a5-4859-a78b-5340276bec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:37.940265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c970a-d4a5-4859-a78b-5340276bec01 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:37.940688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c970a-d4a5-4859-a78b-5340276bec01 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:37.941137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c970a-d4a5-4859-a78b-5340276bec01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:37.954391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c970a-d4a5-4859-a78b-5340276bec01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:37.956940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c970a-d4a5-4859-a78b-5340276bec01 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-860c970a-d4a5-4859-a78b-5340276bec01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:37.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:37.986124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:37.987188 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:37.987188 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:37.987188 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:37.987188 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:37.989529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 384/758] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:37.990552 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c970a-d4a5-4859-a78b-5340276bec01 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:38.039973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f42126-fa57-431d-b704-c560a77f674f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:38.077939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ebecf-bd67-4425-be9d-5aa7f244461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:38.077939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ebecf-bd67-4425-be9d-5aa7f244461e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:38.078251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ebecf-bd67-4425-be9d-5aa7f244461e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:38.078707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ebecf-bd67-4425-be9d-5aa7f244461e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:38.079644 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ebecf-bd67-4425-be9d-5aa7f244461e None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=1fbb465d777c4f02b7777ad154d09c8c) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:38.080605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ebecf-bd67-4425-be9d-5aa7f244461e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:38.081655 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ebecf-bd67-4425-be9d-5aa7f244461e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:38.087532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 375/759] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:37 2022] GET /identity/v3/role_assignments?user.id=1fbb465d777c4f02b7777ad154d09c8c&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:38.088628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ebecf-bd67-4425-be9d-5aa7f244461e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:38.114424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c970a-d4a5-4859-a78b-5340276bec01 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:38.208961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ebecf-bd67-4425-be9d-5aa7f244461e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:38.247150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b3b9b-3240-4580-93e3-889282a43272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:38.248129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3b9b-3240-4580-93e3-889282a43272 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:38.248599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3b9b-3240-4580-93e3-889282a43272 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:38.249081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b3b9b-3240-4580-93e3-889282a43272 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:38.250633 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b3b9b-3240-4580-93e3-889282a43272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:38.251118 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b3b9b-3240-4580-93e3-889282a43272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:38.253179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b3b9b-3240-4580-93e3-889282a43272 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:38.269948 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 376/760] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:38.275624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b3b9b-3240-4580-93e3-889282a43272 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:38.281003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3db1f4-9559-40bb-b800-5ed189aae2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:38.282113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3db1f4-9559-40bb-b800-5ed189aae2a3 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:38.282538 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3db1f4-9559-40bb-b800-5ed189aae2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:38.282952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3db1f4-9559-40bb-b800-5ed189aae2a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:38.291936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3db1f4-9559-40bb-b800-5ed189aae2a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:38.294285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3db1f4-9559-40bb-b800-5ed189aae2a3 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-6f3db1f4-9559-40bb-b800-5ed189aae2a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:38.315177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:38.316340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:38.317424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:38.317424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:38.317424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:38.317424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:38.317424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:38.317424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:38.317424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:38.317424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:38.324292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 385/761] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:38.326263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3db1f4-9559-40bb-b800-5ed189aae2a3 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:38.397147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b3b9b-3240-4580-93e3-889282a43272 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:38.448714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbbea1-cb3e-4bee-a1fc-29beee376587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:38.449515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbbea1-cb3e-4bee-a1fc-29beee376587 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:38.450160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbbea1-cb3e-4bee-a1fc-29beee376587 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:38.450448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbbea1-cb3e-4bee-a1fc-29beee376587 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:38.460718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbbea1-cb3e-4bee-a1fc-29beee376587 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:38.462118 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbbea1-cb3e-4bee-a1fc-29beee376587 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:38.490140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3db1f4-9559-40bb-b800-5ed189aae2a3 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-e0fbbea1-cb3e-4bee-a1fc-29beee376587 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:38.490542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:38.491406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:38.492303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:38.492303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:38.492303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:38.492303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:38.492303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:38.492303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:38.492303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:38.492303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:38.494441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 377/762] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:38.500166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbbea1-cb3e-4bee-a1fc-29beee376587 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:38.525607 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cbb1-a020-4a72-8026-33dfc774d630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:38.526275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cbb1-a020-4a72-8026-33dfc774d630 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:38.526557 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cbb1-a020-4a72-8026-33dfc774d630 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:38.526832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16cbb1-a020-4a72-8026-33dfc774d630 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:38.528208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16cbb1-a020-4a72-8026-33dfc774d630 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:38.528208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16cbb1-a020-4a72-8026-33dfc774d630 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:38.530695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16cbb1-a020-4a72-8026-33dfc774d630 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:38.542341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 386/763] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:38.548303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cbb1-a020-4a72-8026-33dfc774d630 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:38.666347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbbea1-cb3e-4bee-a1fc-29beee376587 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:38.710292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835551da-1528-4d08-8a5b-4363d74e9e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:38.711104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835551da-1528-4d08-8a5b-4363d74e9e4b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:38.711221 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835551da-1528-4d08-8a5b-4363d74e9e4b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:38.711502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835551da-1528-4d08-8a5b-4363d74e9e4b None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:38.714941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835551da-1528-4d08-8a5b-4363d74e9e4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:38.715272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835551da-1528-4d08-8a5b-4363d74e9e4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:38.716754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835551da-1528-4d08-8a5b-4363d74e9e4b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:38.743053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 378/764] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:38.757433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835551da-1528-4d08-8a5b-4363d74e9e4b None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:38.761003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16cbb1-a020-4a72-8026-33dfc774d630 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:38.800360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f2649-cea0-4660-809d-fe0cc10f419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:38.801027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f2649-cea0-4660-809d-fe0cc10f419d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:38.801310 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f2649-cea0-4660-809d-fe0cc10f419d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:38.801588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f2649-cea0-4660-809d-fe0cc10f419d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:38.802422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f2649-cea0-4660-809d-fe0cc10f419d None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=5206e8bbb04042f4b00637518f297a97) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:38.802734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f2649-cea0-4660-809d-fe0cc10f419d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:38.804166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f2649-cea0-4660-809d-fe0cc10f419d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:38.814653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 387/765] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:38 2022] GET /identity/v3/role_assignments?user.id=5206e8bbb04042f4b00637518f297a97&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=3db33dfd3d6544fd81933007633fc56a => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:38.925395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835551da-1528-4d08-8a5b-4363d74e9e4b None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:38.967395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c961847-8c0c-4c4a-9b66-c6baad68753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:38.968504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961847-8c0c-4c4a-9b66-c6baad68753d None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:38.968788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961847-8c0c-4c4a-9b66-c6baad68753d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:38.969063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961847-8c0c-4c4a-9b66-c6baad68753d None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/d86479ff40f54e7793f1771cb6ad362a/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:38.971085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c961847-8c0c-4c4a-9b66-c6baad68753d None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=d86479ff40f54e7793f1771cb6ad362a, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:38.972560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c961847-8c0c-4c4a-9b66-c6baad68753d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:38.990865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 379/766] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:53:38 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/d86479ff40f54e7793f1771cb6ad362a/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:53:39.148053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bfc88-a693-4097-bbb6-91afd5342f90 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:39.148418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bfc88-a693-4097-bbb6-91afd5342f90 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:39.148646 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bfc88-a693-4097-bbb6-91afd5342f90 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:39.150252 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 388/767] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:39.156526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f6c5-c72c-4b88-ae01-4959593c80a9 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:39.156965 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f6c5-c72c-4b88-ae01-4959593c80a9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:39.157246 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1f6c5-c72c-4b88-ae01-4959593c80a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:39.181322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-8fe1f6c5-c72c-4b88-ae01-4959593c80a9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:39.182539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-8fe1f6c5-c72c-4b88-ae01-4959593c80a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:39.261085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 380/768] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:39.284660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bfc88-a693-4097-bbb6-91afd5342f90 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:39.404498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bfc88-a693-4097-bbb6-91afd5342f90 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:39.453140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b512f-53c4-407f-bd1d-9e96b817a4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:39.454300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b512f-53c4-407f-bd1d-9e96b817a4d3 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:39.454817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b512f-53c4-407f-bd1d-9e96b817a4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:39.455279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b512f-53c4-407f-bd1d-9e96b817a4d3 None admin] PATH_INFO: `/v3/services/network` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:39.456141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b512f-53c4-407f-bd1d-9e96b817a4d3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:39.457766 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b512f-53c4-407f-bd1d-9e96b817a4d3 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-807b512f-53c4-407f-bd1d-9e96b817a4d3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:39.474449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:39.475459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 11:53:39.476291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:39.478930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 389/769] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:39 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:39.485026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1f6c5-c72c-4b88-ae01-4959593c80a9 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:39.627470 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1f6c5-c72c-4b88-ae01-4959593c80a9 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:39.667373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a87778-817c-4961-aaf0-959bb0a8d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:39.668048 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a87778-817c-4961-aaf0-959bb0a8d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:39.668371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a87778-817c-4961-aaf0-959bb0a8d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:39.668627 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a87778-817c-4961-aaf0-959bb0a8d7f1 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:39.669354 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a87778-817c-4961-aaf0-959bb0a8d7f1 None admin] RBAC: Adding query filter params (name=network) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:39.669659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a87778-817c-4961-aaf0-959bb0a8d7f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:39.671575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a87778-817c-4961-aaf0-959bb0a8d7f1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:39.676693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 381/770] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:53:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:39.682130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b512f-53c4-407f-bd1d-9e96b817a4d3 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:39.746620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e1374-00e6-4995-8ec6-f0fba9cef5a0 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:39.747129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e1374-00e6-4995-8ec6-f0fba9cef5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:39.747129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e1374-00e6-4995-8ec6-f0fba9cef5a0 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:39.748770 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 382/771] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:53:39.754788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1436-0abc-44a2-97b6-36cbcd3e5ba1 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:39.755069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1436-0abc-44a2-97b6-36cbcd3e5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:39.755343 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc1436-0abc-44a2-97b6-36cbcd3e5ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:39.771962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-c4bc1436-0abc-44a2-97b6-36cbcd3e5ba1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:39.773179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c4bc1436-0abc-44a2-97b6-36cbcd3e5ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:39.796955 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b512f-53c4-407f-bd1d-9e96b817a4d3 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:39.831442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27123e98-104b-43d1-859c-a9712f2e9f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:39.832124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27123e98-104b-43d1-859c-a9712f2e9f43 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:39.832432 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27123e98-104b-43d1-859c-a9712f2e9f43 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:39.832713 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27123e98-104b-43d1-859c-a9712f2e9f43 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:39.833433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27123e98-104b-43d1-859c-a9712f2e9f43 None admin] RBAC: Adding query filter params (type=network) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:39.833743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27123e98-104b-43d1-859c-a9712f2e9f43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:39.835229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27123e98-104b-43d1-859c-a9712f2e9f43 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:39.841487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 390/772] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:53:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:39.848022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27123e98-104b-43d1-859c-a9712f2e9f43 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:39.874993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 383/773] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:53:39.897162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc1436-0abc-44a2-97b6-36cbcd3e5ba1 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:39.971995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27123e98-104b-43d1-859c-a9712f2e9f43 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:39.994344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc1436-0abc-44a2-97b6-36cbcd3e5ba1 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:40.006473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4526b3c-2bef-487f-ac8a-c3822ef52711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:40.007137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4526b3c-2bef-487f-ac8a-c3822ef52711 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:40.007414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4526b3c-2bef-487f-ac8a-c3822ef52711 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:40.007686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4526b3c-2bef-487f-ac8a-c3822ef52711 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:40.008507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4526b3c-2bef-487f-ac8a-c3822ef52711 None admin] RBAC: Adding query filter params (interface=public, service_id=9815b06119a14d9c816e7fe24e6ec2c5, region_id=RegionOne) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:40.008818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4526b3c-2bef-487f-ac8a-c3822ef52711 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:40.010254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4526b3c-2bef-487f-ac8a-c3822ef52711 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:40.022975 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 391/774] 10.222.0.58 () {56 vars in 1251 bytes} [Tue May 17 11:53:39 2022] GET /identity/v3/endpoints?service_id=9815b06119a14d9c816e7fe24e6ec2c5&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:40.024330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4526b3c-2bef-487f-ac8a-c3822ef52711 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:40.029039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef119c5-e7ed-43b8-a5a3-c51bfd08fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:40.029873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef119c5-e7ed-43b8-a5a3-c51bfd08fbe8 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:40.030763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef119c5-e7ed-43b8-a5a3-c51bfd08fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:40.031169 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef119c5-e7ed-43b8-a5a3-c51bfd08fbe8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:40.031902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef119c5-e7ed-43b8-a5a3-c51bfd08fbe8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:40.033351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef119c5-e7ed-43b8-a5a3-c51bfd08fbe8 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-fef119c5-e7ed-43b8-a5a3-c51bfd08fbe8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:40.054483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:40.056830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:40.058888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 384/775] 10.222.0.58 () {56 vars in 1129 bytes} [Tue May 17 11:53:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:40.065123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef119c5-e7ed-43b8-a5a3-c51bfd08fbe8 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:40.127869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4526b3c-2bef-487f-ac8a-c3822ef52711 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:40.161073 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67df8c8-bd4f-4ac3-8533-13fd40ca0c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:40.161750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67df8c8-bd4f-4ac3-8533-13fd40ca0c3c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:40.162008 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67df8c8-bd4f-4ac3-8533-13fd40ca0c3c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:40.162290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67df8c8-bd4f-4ac3-8533-13fd40ca0c3c None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:40.162974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67df8c8-bd4f-4ac3-8533-13fd40ca0c3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:40.164360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67df8c8-bd4f-4ac3-8533-13fd40ca0c3c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:40.176354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 392/776] 10.222.0.58 () {56 vars in 1087 bytes} [Tue May 17 11:53:40 2022] GET /identity/v3/services => generated 772 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:40.219769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef119c5-e7ed-43b8-a5a3-c51bfd08fbe8 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:40.269416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74b743-e893-4406-9004-ea314aef48ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:40.270093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74b743-e893-4406-9004-ea314aef48ac None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:40.270374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74b743-e893-4406-9004-ea314aef48ac None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:40.270643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74b743-e893-4406-9004-ea314aef48ac None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:40.271366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74b743-e893-4406-9004-ea314aef48ac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:40.271671 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74b743-e893-4406-9004-ea314aef48ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:40.273090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74b743-e893-4406-9004-ea314aef48ac None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:40.278593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 385/777] 10.222.0.58 () {56 vars in 1124 bytes} [Tue May 17 11:53:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:40.284270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67df8c8-bd4f-4ac3-8533-13fd40ca0c3c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:40.424707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67df8c8-bd4f-4ac3-8533-13fd40ca0c3c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:40.460836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec42aa-c5e9-46bd-866d-4332f2d3056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:40.461413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec42aa-c5e9-46bd-866d-4332f2d3056c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:40.461741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec42aa-c5e9-46bd-866d-4332f2d3056c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:40.462016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec42aa-c5e9-46bd-866d-4332f2d3056c None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:40.462722 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec42aa-c5e9-46bd-866d-4332f2d3056c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:40.463032 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec42aa-c5e9-46bd-866d-4332f2d3056c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:40.464435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec42aa-c5e9-46bd-866d-4332f2d3056c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:40.470230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 393/778] 10.222.0.58 () {56 vars in 1124 bytes} [Tue May 17 11:53:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:40.475897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74b743-e893-4406-9004-ea314aef48ac None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:40.582305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74b743-e893-4406-9004-ea314aef48ac None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:40.628031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964090a-f71a-46f2-9b65-9bf51e78687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:40.628742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964090a-f71a-46f2-9b65-9bf51e78687d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:40.629022 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964090a-f71a-46f2-9b65-9bf51e78687d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:40.629294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964090a-f71a-46f2-9b65-9bf51e78687d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:40.630087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964090a-f71a-46f2-9b65-9bf51e78687d None admin] RBAC: Adding query filter params (interface=public, service_id=fb63d1dfe79f4ee7b49201b1b7981359, region_id=RegionOne) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:40.630398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964090a-f71a-46f2-9b65-9bf51e78687d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:40.631752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964090a-f71a-46f2-9b65-9bf51e78687d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:40.639873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 386/779] 10.222.0.58 () {56 vars in 1251 bytes} [Tue May 17 11:53:40 2022] GET /identity/v3/endpoints?service_id=fb63d1dfe79f4ee7b49201b1b7981359&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:40.645384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec42aa-c5e9-46bd-866d-4332f2d3056c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:40.783198 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec42aa-c5e9-46bd-866d-4332f2d3056c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:40.828892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c949f0-da35-4352-920e-e2d9a56aa693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:40.829659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c949f0-da35-4352-920e-e2d9a56aa693 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:40.829829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c949f0-da35-4352-920e-e2d9a56aa693 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:40.830110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c949f0-da35-4352-920e-e2d9a56aa693 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:40.830794 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c949f0-da35-4352-920e-e2d9a56aa693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:40.832164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c949f0-da35-4352-920e-e2d9a56aa693 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:40.837749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 394/780] 10.222.0.58 () {56 vars in 1087 bytes} [Tue May 17 11:53:40 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:41.201561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fb608-0c03-4161-92aa-e7062e854790 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:41.202101 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fb608-0c03-4161-92aa-e7062e854790 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:41.202747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fb608-0c03-4161-92aa-e7062e854790 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:41.203757 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 387/781] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:41.208853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123589-e295-48b1-8980-2dddcbab7910 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:41.209141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123589-e295-48b1-8980-2dddcbab7910 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:41.209420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11123589-e295-48b1-8980-2dddcbab7910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:41.232496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-11123589-e295-48b1-8980-2dddcbab7910 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:41.234383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-11123589-e295-48b1-8980-2dddcbab7910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:41.328913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 395/782] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:41.363176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fb608-0c03-4161-92aa-e7062e854790 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:41.500896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fb608-0c03-4161-92aa-e7062e854790 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:41.543777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcca1c-9064-4db8-9d3e-ffe489d83f97 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:41.544079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcca1c-9064-4db8-9d3e-ffe489d83f97 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:41.544361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcca1c-9064-4db8-9d3e-ffe489d83f97 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:41.544919 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf845ab-cca6-4e14-a1ed-399ceca51f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:41.546585 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf845ab-cca6-4e14-a1ed-399ceca51f86 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:41.546698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 396/783] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:53:41.546775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf845ab-cca6-4e14-a1ed-399ceca51f86 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:41.546775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf845ab-cca6-4e14-a1ed-399ceca51f86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:41.554701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5f772-fcaa-4680-b2db-f13901e7784f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:41.554994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5f772-fcaa-4680-b2db-f13901e7784f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:41.555273 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5f772-fcaa-4680-b2db-f13901e7784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:41.575457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf845ab-cca6-4e14-a1ed-399ceca51f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:41.585501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-eef5f772-fcaa-4680-b2db-f13901e7784f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:41.586746 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-eef5f772-fcaa-4680-b2db-f13901e7784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-ddf845ab-cca6-4e14-a1ed-399ceca51f86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:41.591832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:41.593957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:41.594796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 388/784] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:41.601109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf845ab-cca6-4e14-a1ed-399ceca51f86 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:41.695063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 397/785] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:53:41.741617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5f772-fcaa-4680-b2db-f13901e7784f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:41.742906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf845ab-cca6-4e14-a1ed-399ceca51f86 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:41.776228 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67c104-86d6-489b-87cd-e1b73fe3aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:41.776821 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c104-86d6-489b-87cd-e1b73fe3aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:41.777102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c104-86d6-489b-87cd-e1b73fe3aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:41.777371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67c104-86d6-489b-87cd-e1b73fe3aeb5 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:41.778116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67c104-86d6-489b-87cd-e1b73fe3aeb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:41.778441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67c104-86d6-489b-87cd-e1b73fe3aeb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:41.779787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67c104-86d6-489b-87cd-e1b73fe3aeb5 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:41.788713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 389/786] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:41.794171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67c104-86d6-489b-87cd-e1b73fe3aeb5 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:41.893859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67c104-86d6-489b-87cd-e1b73fe3aeb5 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:41.928022 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404b513-585d-46a1-9187-ab7c3fb5b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:41.928851 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404b513-585d-46a1-9187-ab7c3fb5b64a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:41.929129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404b513-585d-46a1-9187-ab7c3fb5b64a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:41.929401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404b513-585d-46a1-9187-ab7c3fb5b64a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:41.929996 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5f772-fcaa-4680-b2db-f13901e7784f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:41.942001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404b513-585d-46a1-9187-ab7c3fb5b64a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:41.943492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404b513-585d-46a1-9187-ab7c3fb5b64a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-4404b513-585d-46a1-9187-ab7c3fb5b64a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:41.961723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:41.962623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:41.963488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:41.963488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:41.963488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:41.963488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:41.963488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 390/787] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:41.969151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742629-29ae-4fe0-8444-904cd2203c06 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:41.969441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742629-29ae-4fe0-8444-904cd2203c06 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:41.969716 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51742629-29ae-4fe0-8444-904cd2203c06 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:41.969890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881df6-585f-4b55-9574-f79a1cfc8f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:41.970679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881df6-585f-4b55-9574-f79a1cfc8f0a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:41.970962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881df6-585f-4b55-9574-f79a1cfc8f0a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:41.971219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 391/788] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:41.971382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881df6-585f-4b55-9574-f79a1cfc8f0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:41.971928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742629-29ae-4fe0-8444-904cd2203c06 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:41.982484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b881df6-585f-4b55-9574-f79a1cfc8f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-9b881df6-585f-4b55-9574-f79a1cfc8f0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:41.990687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:41.992883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:41.994923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:41.996553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 398/789] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:42.004223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d88cc-ed63-441a-ac46-91e698e2d037 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.004223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d88cc-ed63-441a-ac46-91e698e2d037 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.004223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d88cc-ed63-441a-ac46-91e698e2d037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.016503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-0c1d88cc-ed63-441a-ac46-91e698e2d037 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:42.017683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0c1d88cc-ed63-441a-ac46-91e698e2d037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:42.074467 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51742629-29ae-4fe0-8444-904cd2203c06 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:42.090635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 399/790] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:42.091971 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d88cc-ed63-441a-ac46-91e698e2d037 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:42.108959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e569b1-2e6e-4de3-bed4-bbe22110e77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:42.109622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e569b1-2e6e-4de3-bed4-bbe22110e77f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.109903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e569b1-2e6e-4de3-bed4-bbe22110e77f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.110176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e569b1-2e6e-4de3-bed4-bbe22110e77f None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.110902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e569b1-2e6e-4de3-bed4-bbe22110e77f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:42.111207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e569b1-2e6e-4de3-bed4-bbe22110e77f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:42.112618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e569b1-2e6e-4de3-bed4-bbe22110e77f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:42.125883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 392/791] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:42.131029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e569b1-2e6e-4de3-bed4-bbe22110e77f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:42.208831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d88cc-ed63-441a-ac46-91e698e2d037 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:42.230566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e569b1-2e6e-4de3-bed4-bbe22110e77f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:42.242494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20028d5-1d95-4267-b437-1e604d0f916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:42.243166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20028d5-1d95-4267-b437-1e604d0f916b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.243451 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20028d5-1d95-4267-b437-1e604d0f916b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.243726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20028d5-1d95-4267-b437-1e604d0f916b None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.244516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20028d5-1d95-4267-b437-1e604d0f916b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:42.244824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20028d5-1d95-4267-b437-1e604d0f916b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:42.246204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20028d5-1d95-4267-b437-1e604d0f916b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:42.259058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 400/792] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:42.259940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20028d5-1d95-4267-b437-1e604d0f916b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:42.263540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a2e86-4c79-4ae1-b089-595147e88987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:42.264900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a2e86-4c79-4ae1-b089-595147e88987 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.265674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a2e86-4c79-4ae1-b089-595147e88987 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.265674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a2e86-4c79-4ae1-b089-595147e88987 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.273026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a2e86-4c79-4ae1-b089-595147e88987 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:42.274420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a2e86-4c79-4ae1-b089-595147e88987 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-368a2e86-4c79-4ae1-b089-595147e88987 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:42.289765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:42.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 393/793] 10.222.0.58 () {56 vars in 1117 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:42.294337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a2e86-4c79-4ae1-b089-595147e88987 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:42.361170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20028d5-1d95-4267-b437-1e604d0f916b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:42.395990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a2e86-4c79-4ae1-b089-595147e88987 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:42.396652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0412b8-3132-4c30-84c3-a732287d1f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:42.397447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0412b8-3132-4c30-84c3-a732287d1f44 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.397725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0412b8-3132-4c30-84c3-a732287d1f44 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.397987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0412b8-3132-4c30-84c3-a732287d1f44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.408876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0412b8-3132-4c30-84c3-a732287d1f44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-5d0412b8-3132-4c30-84c3-a732287d1f44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:42.416464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:42.418696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 401/794] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:42.422064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0412b8-3132-4c30-84c3-a732287d1f44 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:42.432773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45def7c-5581-4817-82cf-6858f2a90014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:42.432773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45def7c-5581-4817-82cf-6858f2a90014 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.432773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45def7c-5581-4817-82cf-6858f2a90014 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.432773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45def7c-5581-4817-82cf-6858f2a90014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.443477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45def7c-5581-4817-82cf-6858f2a90014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:42.445038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45def7c-5581-4817-82cf-6858f2a90014 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-e45def7c-5581-4817-82cf-6858f2a90014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:42.463910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:42.467396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:42.470617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:42.470617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:42.470617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:42.470617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:42.470617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 394/795] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:42.470617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45def7c-5581-4817-82cf-6858f2a90014 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:42.542549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0412b8-3132-4c30-84c3-a732287d1f44 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:42.576693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd61fb0-b798-4b8d-823f-01c25f305e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:42.577394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd61fb0-b798-4b8d-823f-01c25f305e2c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.578015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd61fb0-b798-4b8d-823f-01c25f305e2c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.578015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd61fb0-b798-4b8d-823f-01c25f305e2c None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.578768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd61fb0-b798-4b8d-823f-01c25f305e2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:42.579077 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd61fb0-b798-4b8d-823f-01c25f305e2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:42.580542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd61fb0-b798-4b8d-823f-01c25f305e2c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:42.581057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45def7c-5581-4817-82cf-6858f2a90014 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:42.598640 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 402/796] 10.222.0.58 () {56 vars in 1149 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:42.599489 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd61fb0-b798-4b8d-823f-01c25f305e2c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:42.620240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375748de-e5c2-42d1-b116-c9107be58a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:42.620869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375748de-e5c2-42d1-b116-c9107be58a57 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.621148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375748de-e5c2-42d1-b116-c9107be58a57 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.621425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375748de-e5c2-42d1-b116-c9107be58a57 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.622170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375748de-e5c2-42d1-b116-c9107be58a57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:42.622473 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375748de-e5c2-42d1-b116-c9107be58a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:42.624073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375748de-e5c2-42d1-b116-c9107be58a57 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:42.632548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 395/797] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:42.633342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375748de-e5c2-42d1-b116-c9107be58a57 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:42.699508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd61fb0-b798-4b8d-823f-01c25f305e2c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:42.731478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375748de-e5c2-42d1-b116-c9107be58a57 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:42.735174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08484b25-9f7e-4673-bd99-337dbfafbda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:42.735846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08484b25-9f7e-4673-bd99-337dbfafbda8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.736128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08484b25-9f7e-4673-bd99-337dbfafbda8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.736441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08484b25-9f7e-4673-bd99-337dbfafbda8 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.737163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08484b25-9f7e-4673-bd99-337dbfafbda8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:42.737469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08484b25-9f7e-4673-bd99-337dbfafbda8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:42.738841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08484b25-9f7e-4673-bd99-337dbfafbda8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:42.756428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 403/798] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:42.757790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08484b25-9f7e-4673-bd99-337dbfafbda8 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:42.767784 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b4a9e-c039-4c14-bb84-fa35231cbe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:42.768653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b4a9e-c039-4c14-bb84-fa35231cbe2e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.768924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b4a9e-c039-4c14-bb84-fa35231cbe2e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.769619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b4a9e-c039-4c14-bb84-fa35231cbe2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.780887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b4a9e-c039-4c14-bb84-fa35231cbe2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:42.782179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b4a9e-c039-4c14-bb84-fa35231cbe2e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-a41b4a9e-c039-4c14-bb84-fa35231cbe2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:42.801206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:42.803361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:42.805729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:42.805729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:42.805729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:42.805729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:42.805729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 396/799] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:42.805729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b4a9e-c039-4c14-bb84-fa35231cbe2e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:42.860394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08484b25-9f7e-4673-bd99-337dbfafbda8 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:42.894358 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952602e-bd01-4d2b-85e9-95482f749244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:42.895076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952602e-bd01-4d2b-85e9-95482f749244 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.895357 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952602e-bd01-4d2b-85e9-95482f749244 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.895632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952602e-bd01-4d2b-85e9-95482f749244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.906338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952602e-bd01-4d2b-85e9-95482f749244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:42.907386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b4a9e-c039-4c14-bb84-fa35231cbe2e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:42.907747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952602e-bd01-4d2b-85e9-95482f749244 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-3952602e-bd01-4d2b-85e9-95482f749244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:42.925299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:42.927474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:42.929790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:42.929790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:42.929790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:42.929790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:42.929790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 404/800] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:42.929790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952602e-bd01-4d2b-85e9-95482f749244 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:42.941459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ccb63-2786-4db6-acda-adb5d6decb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:42.942360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ccb63-2786-4db6-acda-adb5d6decb17 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:42.942633 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ccb63-2786-4db6-acda-adb5d6decb17 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:42.942941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ccb63-2786-4db6-acda-adb5d6decb17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:42.952396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ccb63-2786-4db6-acda-adb5d6decb17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:42.953902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ccb63-2786-4db6-acda-adb5d6decb17 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-489ccb63-2786-4db6-acda-adb5d6decb17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:42.969230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:42.971513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 397/801] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:42.973940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ccb63-2786-4db6-acda-adb5d6decb17 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:43.034492 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952602e-bd01-4d2b-85e9-95482f749244 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:43.068984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762b9bd-4145-442a-ad03-187d11268791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:43.069666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762b9bd-4145-442a-ad03-187d11268791 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.069949 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762b9bd-4145-442a-ad03-187d11268791 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.070224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762b9bd-4145-442a-ad03-187d11268791 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.070958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762b9bd-4145-442a-ad03-187d11268791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:43.071265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762b9bd-4145-442a-ad03-187d11268791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:43.072305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ccb63-2786-4db6-acda-adb5d6decb17 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:43.072709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762b9bd-4145-442a-ad03-187d11268791 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:43.087156 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 405/802] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:43.088053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762b9bd-4145-442a-ad03-187d11268791 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:43.114753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b86411-cb2a-4b90-8738-2585a01d3445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:43.115423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b86411-cb2a-4b90-8738-2585a01d3445 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.115703 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b86411-cb2a-4b90-8738-2585a01d3445 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.115973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b86411-cb2a-4b90-8738-2585a01d3445 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.116731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b86411-cb2a-4b90-8738-2585a01d3445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:43.117037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b86411-cb2a-4b90-8738-2585a01d3445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:43.118463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b86411-cb2a-4b90-8738-2585a01d3445 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:43.131955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 398/803] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:43.132904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b86411-cb2a-4b90-8738-2585a01d3445 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:43.190464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762b9bd-4145-442a-ad03-187d11268791 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:43.224452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72bf22-7d83-4d63-8cbc-c3f53601f0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:43.225126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72bf22-7d83-4d63-8cbc-c3f53601f0d5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.225411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72bf22-7d83-4d63-8cbc-c3f53601f0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.225684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72bf22-7d83-4d63-8cbc-c3f53601f0d5 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.226522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72bf22-7d83-4d63-8cbc-c3f53601f0d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:43.226831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72bf22-7d83-4d63-8cbc-c3f53601f0d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:43.228300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72bf22-7d83-4d63-8cbc-c3f53601f0d5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:43.231718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b86411-cb2a-4b90-8738-2585a01d3445 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:43.250706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 406/804] 10.222.0.58 () {56 vars in 1135 bytes} [Tue May 17 11:53:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:43.251628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72bf22-7d83-4d63-8cbc-c3f53601f0d5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:43.267109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b9a84-a237-4923-b059-85ba71f3a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:43.267941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b9a84-a237-4923-b059-85ba71f3a06f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.268281 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b9a84-a237-4923-b059-85ba71f3a06f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.268561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b9a84-a237-4923-b059-85ba71f3a06f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.275633 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b9a84-a237-4923-b059-85ba71f3a06f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:43.277210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b9a84-a237-4923-b059-85ba71f3a06f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-384b9a84-a237-4923-b059-85ba71f3a06f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:43.291796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:43.294049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:43.297130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:43.297130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:43.297130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:43.297130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:43.297130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:43.297130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:43.297130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:43.297130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:43.297130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 399/805] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:43.297130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b9a84-a237-4923-b059-85ba71f3a06f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:43.355676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72bf22-7d83-4d63-8cbc-c3f53601f0d5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:43.390021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f57e4-787b-4807-8370-e377c33f4af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:43.391092 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f57e4-787b-4807-8370-e377c33f4af6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.391522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f57e4-787b-4807-8370-e377c33f4af6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.391942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f57e4-787b-4807-8370-e377c33f4af6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.398836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b9a84-a237-4923-b059-85ba71f3a06f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:43.399486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f57e4-787b-4807-8370-e377c33f4af6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:43.401008 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f57e4-787b-4807-8370-e377c33f4af6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-c40f57e4-787b-4807-8370-e377c33f4af6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:43.416000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:43.417195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 407/806] 10.222.0.58 () {56 vars in 1093 bytes} [Tue May 17 11:53:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd511-9f0e-4f31-b241-30f93cbf4351 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.419014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd511-9f0e-4f31-b241-30f93cbf4351 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.419696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd511-9f0e-4f31-b241-30f93cbf4351 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.421423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 408/807] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:43.424231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd511-9f0e-4f31-b241-30f93cbf4351 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:43.441235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d1e6b-8f00-4bd9-9890-3a1778e3b92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:43.441960 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1e6b-8f00-4bd9-9890-3a1778e3b92e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.442245 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1e6b-8f00-4bd9-9890-3a1778e3b92e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.442522 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1e6b-8f00-4bd9-9890-3a1778e3b92e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.454182 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d1e6b-8f00-4bd9-9890-3a1778e3b92e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:43.455740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d1e6b-8f00-4bd9-9890-3a1778e3b92e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-8a6d1e6b-8f00-4bd9-9890-3a1778e3b92e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:43.472792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:43.473711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:43.474586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:43.474586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:43.474586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:43.474586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:43.474586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 400/808] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:43.474870 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d1e6b-8f00-4bd9-9890-3a1778e3b92e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:43.529831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd511-9f0e-4f31-b241-30f93cbf4351 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:43.563632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43a730-b7c4-4526-993f-11b8e91f532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:43.564320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a730-b7c4-4526-993f-11b8e91f532b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.564604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a730-b7c4-4526-993f-11b8e91f532b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.564878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a730-b7c4-4526-993f-11b8e91f532b None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.565653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43a730-b7c4-4526-993f-11b8e91f532b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:43.565961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43a730-b7c4-4526-993f-11b8e91f532b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:43.567379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43a730-b7c4-4526-993f-11b8e91f532b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:43.571060 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d1e6b-8f00-4bd9-9890-3a1778e3b92e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:43.578580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 409/809] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:43.579783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994e06-e701-406e-86e1-eada8706d390 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.580068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994e06-e701-406e-86e1-eada8706d390 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.580389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab994e06-e701-406e-86e1-eada8706d390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.595640 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ab994e06-e701-406e-86e1-eada8706d390 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:43.596830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ab994e06-e701-406e-86e1-eada8706d390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:43.603200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ebd9c-8f0c-492c-a079-a83e016ae0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:43.603861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ebd9c-8f0c-492c-a079-a83e016ae0ea None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.604145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ebd9c-8f0c-492c-a079-a83e016ae0ea None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.604452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ebd9c-8f0c-492c-a079-a83e016ae0ea None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.605280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ebd9c-8f0c-492c-a079-a83e016ae0ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:43.605599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ebd9c-8f0c-492c-a079-a83e016ae0ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:43.607012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ebd9c-8f0c-492c-a079-a83e016ae0ea None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:43.625484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 401/810] 10.222.0.58 () {56 vars in 1133 bytes} [Tue May 17 11:53:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:43.626275 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ebd9c-8f0c-492c-a079-a83e016ae0ea None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:43.663441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 410/811] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:43.664802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a60f-5ae4-4d0b-9214-4400bb1a586b None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.665090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a60f-5ae4-4d0b-9214-4400bb1a586b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.665362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a60f-5ae4-4d0b-9214-4400bb1a586b None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.666860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 411/812] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:43.667537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30a60f-5ae4-4d0b-9214-4400bb1a586b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:43.724541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ebd9c-8f0c-492c-a079-a83e016ae0ea None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:43.756440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c335efb-90b9-4fad-a479-cba4e0b2e764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:43.757095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c335efb-90b9-4fad-a479-cba4e0b2e764 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.757379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c335efb-90b9-4fad-a479-cba4e0b2e764 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.757654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c335efb-90b9-4fad-a479-cba4e0b2e764 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.758363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c335efb-90b9-4fad-a479-cba4e0b2e764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:43.758668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c335efb-90b9-4fad-a479-cba4e0b2e764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:43.760023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c335efb-90b9-4fad-a479-cba4e0b2e764 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:43.766040 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30a60f-5ae4-4d0b-9214-4400bb1a586b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:43.771382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 402/813] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:43.772196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c335efb-90b9-4fad-a479-cba4e0b2e764 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:43.800128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba633ce6-8264-4535-a6e1-ed108e1163b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:43.801027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633ce6-8264-4535-a6e1-ed108e1163b8 None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.801308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633ce6-8264-4535-a6e1-ed108e1163b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.801582 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633ce6-8264-4535-a6e1-ed108e1163b8 None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/1fbb465d777c4f02b7777ad154d09c8c/roles/50a905462253442da9d5dac9a4dd30ae` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.815887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba633ce6-8264-4535-a6e1-ed108e1163b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=1fbb465d777c4f02b7777ad154d09c8c, role_id=50a905462253442da9d5dac9a4dd30ae)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:43.817349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba633ce6-8264-4535-a6e1-ed108e1163b8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:43.830706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 412/814] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:53:43 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/1fbb465d777c4f02b7777ad154d09c8c/roles/50a905462253442da9d5dac9a4dd30ae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:53:43.832091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0c9cc-27c1-4e9b-852c-10ca24f209d8 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.832576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0c9cc-27c1-4e9b-852c-10ca24f209d8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.833014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0c9cc-27c1-4e9b-852c-10ca24f209d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.854919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-91f0c9cc-27c1-4e9b-852c-10ca24f209d8 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:43.856135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-91f0c9cc-27c1-4e9b-852c-10ca24f209d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:43.874916 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c335efb-90b9-4fad-a479-cba4e0b2e764 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:43.910717 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3f3b2-0328-4280-b1cb-d81a299ae8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:43.911385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3f3b2-0328-4280-b1cb-d81a299ae8ba None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:43.911666 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3f3b2-0328-4280-b1cb-d81a299ae8ba None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:43.911938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3f3b2-0328-4280-b1cb-d81a299ae8ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:43.926691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 413/815] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:43.928030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0c9cc-27c1-4e9b-852c-10ca24f209d8 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:43.996799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3f3b2-0328-4280-b1cb-d81a299ae8ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:43.998197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3f3b2-0328-4280-b1cb-d81a299ae8ba None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.041940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0c9cc-27c1-4e9b-852c-10ca24f209d8 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:44.077817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1ddbf-4577-4a9a-88d0-561f5203db7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:44.078616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1ddbf-4577-4a9a-88d0-561f5203db7c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:44.078903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1ddbf-4577-4a9a-88d0-561f5203db7c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:44.079177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1ddbf-4577-4a9a-88d0-561f5203db7c None admin] PATH_INFO: `/v3/services/network` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:44.079836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1ddbf-4577-4a9a-88d0-561f5203db7c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:44.081261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1ddbf-4577-4a9a-88d0-561f5203db7c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-d0c1ddbf-4577-4a9a-88d0-561f5203db7c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:44.093369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:44.094348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:44.095149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 414/816] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:43 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:44.095914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1ddbf-4577-4a9a-88d0-561f5203db7c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.108542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 403/817] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:53:44.109402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3f3b2-0328-4280-b1cb-d81a299ae8ba None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.198947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1ddbf-4577-4a9a-88d0-561f5203db7c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:44.206847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3f3b2-0328-4280-b1cb-d81a299ae8ba None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:44.232060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74a86-51a9-428e-b337-02fc4496ed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:44.232890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74a86-51a9-428e-b337-02fc4496ed3c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:44.233882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74a86-51a9-428e-b337-02fc4496ed3c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:44.234201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec74a86-51a9-428e-b337-02fc4496ed3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:44.240993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec74a86-51a9-428e-b337-02fc4496ed3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:44.241294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b44a0-51f7-4920-9c3b-947a637593a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:44.242102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b44a0-51f7-4920-9c3b-947a637593a4 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:44.242378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b44a0-51f7-4920-9c3b-947a637593a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:44.242472 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec74a86-51a9-428e-b337-02fc4496ed3c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.242646 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b44a0-51f7-4920-9c3b-947a637593a4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:44.243480 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b44a0-51f7-4920-9c3b-947a637593a4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:44.245356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b44a0-51f7-4920-9c3b-947a637593a4 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-dec74a86-51a9-428e-b337-02fc4496ed3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:44.257667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:44.258594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:44.259445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:44.259445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:44.259445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:44.259445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:44.259445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:44.259445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:44.259445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:44.259445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-710b44a0-51f7-4920-9c3b-947a637593a4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:44.260488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:44.261317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 11:53:44.263420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:44.265692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 415/819] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:44.265927 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 404/819] 10.222.0.58 () {56 vars in 1129 bytes} [Tue May 17 11:53:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:44.266068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74a86-51a9-428e-b337-02fc4496ed3c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.266219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b44a0-51f7-4920-9c3b-947a637593a4 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.365598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec74a86-51a9-428e-b337-02fc4496ed3c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:44.367179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b44a0-51f7-4920-9c3b-947a637593a4 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:44.399351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc65722-21ab-4b41-8b48-76229be7dc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:44.400130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc65722-21ab-4b41-8b48-76229be7dc3c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:44.400446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc65722-21ab-4b41-8b48-76229be7dc3c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:44.400721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc65722-21ab-4b41-8b48-76229be7dc3c None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:44.401418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc65722-21ab-4b41-8b48-76229be7dc3c None admin] RBAC: Adding query filter params (name=network) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:44.401723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc65722-21ab-4b41-8b48-76229be7dc3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:44.403087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc65722-21ab-4b41-8b48-76229be7dc3c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.406395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d933a-f709-4de6-aeed-9e242ced567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:44.407196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d933a-f709-4de6-aeed-9e242ced567f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:44.407482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d933a-f709-4de6-aeed-9e242ced567f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:44.407759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d933a-f709-4de6-aeed-9e242ced567f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:44.412297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 416/820] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:53:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:44.413166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc65722-21ab-4b41-8b48-76229be7dc3c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.420500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d933a-f709-4de6-aeed-9e242ced567f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:44.423107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d933a-f709-4de6-aeed-9e242ced567f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-2e8d933a-f709-4de6-aeed-9e242ced567f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:44.441864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:44.442736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:44.443584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:44.443584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:44.443584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:44.443584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:44.443584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 405/821] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:44.443859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d933a-f709-4de6-aeed-9e242ced567f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.514061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc65722-21ab-4b41-8b48-76229be7dc3c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:44.550972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d933a-f709-4de6-aeed-9e242ced567f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:44.554556 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa32af-a136-4fd9-88a4-49fc8c8f0df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:44.555211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa32af-a136-4fd9-88a4-49fc8c8f0df1 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:44.555493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa32af-a136-4fd9-88a4-49fc8c8f0df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:44.555765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa32af-a136-4fd9-88a4-49fc8c8f0df1 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:44.556590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa32af-a136-4fd9-88a4-49fc8c8f0df1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:44.556897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa32af-a136-4fd9-88a4-49fc8c8f0df1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:44.558428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa32af-a136-4fd9-88a4-49fc8c8f0df1 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.576981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 417/822] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:44.577587 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa32af-a136-4fd9-88a4-49fc8c8f0df1 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.584664 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0b8b4-4a2d-4f23-9662-bddb4c1f3c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:44.585335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0b8b4-4a2d-4f23-9662-bddb4c1f3c0e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:44.585616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0b8b4-4a2d-4f23-9662-bddb4c1f3c0e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:44.585892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0b8b4-4a2d-4f23-9662-bddb4c1f3c0e None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:44.587036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0b8b4-4a2d-4f23-9662-bddb4c1f3c0e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:44.587351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0b8b4-4a2d-4f23-9662-bddb4c1f3c0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:44.588762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0b8b4-4a2d-4f23-9662-bddb4c1f3c0e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.598641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 406/823] 10.222.0.58 () {56 vars in 1124 bytes} [Tue May 17 11:53:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:44.598641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0b8b4-4a2d-4f23-9662-bddb4c1f3c0e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.678821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa32af-a136-4fd9-88a4-49fc8c8f0df1 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:44.692044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0b8b4-4a2d-4f23-9662-bddb4c1f3c0e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:44.711732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de4722-d415-4543-921c-87e31e67e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:44.712427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de4722-d415-4543-921c-87e31e67e02a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:44.712715 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de4722-d415-4543-921c-87e31e67e02a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:44.712996 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de4722-d415-4543-921c-87e31e67e02a None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:44.713698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de4722-d415-4543-921c-87e31e67e02a None admin] RBAC: Adding query filter params (type=network) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:44.714007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de4722-d415-4543-921c-87e31e67e02a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:44.715371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de4722-d415-4543-921c-87e31e67e02a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.724713 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 418/824] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:53:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:44.724713 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de4722-d415-4543-921c-87e31e67e02a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.728087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ccf0a-eb7e-4b94-a6f6-592b5175fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:44.728765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ccf0a-eb7e-4b94-a6f6-592b5175fcaa None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:44.729045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ccf0a-eb7e-4b94-a6f6-592b5175fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:44.729317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ccf0a-eb7e-4b94-a6f6-592b5175fcaa None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:44.730033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ccf0a-eb7e-4b94-a6f6-592b5175fcaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:44.730341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ccf0a-eb7e-4b94-a6f6-592b5175fcaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:44.731688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ccf0a-eb7e-4b94-a6f6-592b5175fcaa None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.743396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 407/825] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:44.744026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ccf0a-eb7e-4b94-a6f6-592b5175fcaa None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.822631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de4722-d415-4543-921c-87e31e67e02a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:44.839014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ccf0a-eb7e-4b94-a6f6-592b5175fcaa None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:44.854450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebf640-7987-4904-8bd3-c230d19589b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:44.855324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebf640-7987-4904-8bd3-c230d19589b4 None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:44.855606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebf640-7987-4904-8bd3-c230d19589b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:44.855881 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebf640-7987-4904-8bd3-c230d19589b4 None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/5206e8bbb04042f4b00637518f297a97/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:44.857921 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebf640-7987-4904-8bd3-c230d19589b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=5206e8bbb04042f4b00637518f297a97, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:44.859459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebf640-7987-4904-8bd3-c230d19589b4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.872136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 419/826] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:53:44 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/5206e8bbb04042f4b00637518f297a97/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:53:44.872973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebf640-7987-4904-8bd3-c230d19589b4 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.876841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bbb32-7a0b-42fe-9886-9b18f49ab5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:44.877596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bbb32-7a0b-42fe-9886-9b18f49ab5f2 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:44.877874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bbb32-7a0b-42fe-9886-9b18f49ab5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:44.878145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bbb32-7a0b-42fe-9886-9b18f49ab5f2 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:44.878887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bbb32-7a0b-42fe-9886-9b18f49ab5f2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:44.879192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bbb32-7a0b-42fe-9886-9b18f49ab5f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:44.886576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bbb32-7a0b-42fe-9886-9b18f49ab5f2 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:44.886576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 408/827] 10.222.0.58 () {56 vars in 1124 bytes} [Tue May 17 11:53:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:44.889427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bbb32-7a0b-42fe-9886-9b18f49ab5f2 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:44.988961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebf640-7987-4904-8bd3-c230d19589b4 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:45.002020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bbb32-7a0b-42fe-9886-9b18f49ab5f2 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:45.026066 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c82bc-bbea-4d29-96fc-ab7b2c245e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:45.026740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c82bc-bbea-4d29-96fc-ab7b2c245e43 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:45.027020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c82bc-bbea-4d29-96fc-ab7b2c245e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:45.027292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c82bc-bbea-4d29-96fc-ab7b2c245e43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:45.028035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c82bc-bbea-4d29-96fc-ab7b2c245e43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:45.029470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c82bc-bbea-4d29-96fc-ab7b2c245e43 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:45.039161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c868093-a35d-443a-9022-240ab6989b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:45.039959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868093-a35d-443a-9022-240ab6989b1e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:45.040359 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868093-a35d-443a-9022-240ab6989b1e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:45.040548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868093-a35d-443a-9022-240ab6989b1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:45.049238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c868093-a35d-443a-9022-240ab6989b1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:45.050706 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c868093-a35d-443a-9022-240ab6989b1e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:45.055885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 420/828] 10.222.0.58 () {60 vars in 1144 bytes} [Tue May 17 11:53:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:53:45.056955 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c82bc-bbea-4d29-96fc-ab7b2c245e43 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-7c868093-a35d-443a-9022-240ab6989b1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:45.075659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:45.076653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:45.078052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:45.078052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:45.078052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:45.078052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:45.078052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:45.078052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:45.078052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:45.078052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:45.084696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 409/829] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:45.090559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c868093-a35d-443a-9022-240ab6989b1e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:45.243931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c868093-a35d-443a-9022-240ab6989b1e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:45.257398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c82bc-bbea-4d29-96fc-ab7b2c245e43 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:45.307244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c2a5-5416-4f61-9c7e-679e9723a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:45.307916 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c2a5-5416-4f61-9c7e-679e9723a586 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:45.308219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c2a5-5416-4f61-9c7e-679e9723a586 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:45.308506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c2a5-5416-4f61-9c7e-679e9723a586 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:45.309303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22c2a5-5416-4f61-9c7e-679e9723a586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:45.309616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22c2a5-5416-4f61-9c7e-679e9723a586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:45.309728 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80d41-8852-4ab0-bba7-e2a377d29757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:45.310304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80d41-8852-4ab0-bba7-e2a377d29757 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:45.310841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80d41-8852-4ab0-bba7-e2a377d29757 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:45.311113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80d41-8852-4ab0-bba7-e2a377d29757 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:45.312054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22c2a5-5416-4f61-9c7e-679e9723a586 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:45.312471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80d41-8852-4ab0-bba7-e2a377d29757 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:45.313884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80d41-8852-4ab0-bba7-e2a377d29757 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:45.329538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 410/830] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:45.335337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c2a5-5416-4f61-9c7e-679e9723a586 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:45.338838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 421/831] 10.222.0.58 () {60 vars in 1144 bytes} [Tue May 17 11:53:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:53:45.463047 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c2a5-5416-4f61-9c7e-679e9723a586 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:45.506442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec40be-3356-4975-a03c-2818b4e35d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:45.507188 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec40be-3356-4975-a03c-2818b4e35d0a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:45.507467 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec40be-3356-4975-a03c-2818b4e35d0a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:45.507739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec40be-3356-4975-a03c-2818b4e35d0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:45.510327 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec40be-3356-4975-a03c-2818b4e35d0a None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=d86479ff40f54e7793f1771cb6ad362a) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:45.510651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec40be-3356-4975-a03c-2818b4e35d0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:45.512122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec40be-3356-4975-a03c-2818b4e35d0a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:45.519647 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 411/832] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:45 2022] GET /identity/v3/role_assignments?user.id=d86479ff40f54e7793f1771cb6ad362a&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=3db33dfd3d6544fd81933007633fc56a => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:46.211147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185e51-f912-4948-8329-30a6bb345383 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:46.211838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185e51-f912-4948-8329-30a6bb345383 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:46.211838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185e51-f912-4948-8329-30a6bb345383 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:46.213337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 422/833] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:46.218797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c424-275d-4424-a1c5-c17ce85d8fdd None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:46.219340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c424-275d-4424-a1c5-c17ce85d8fdd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:46.219814 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c424-275d-4424-a1c5-c17ce85d8fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:46.236996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-8898c424-275d-4424-a1c5-c17ce85d8fdd None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:46.238494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-8898c424-275d-4424-a1c5-c17ce85d8fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:46.306633 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 412/834] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:46.331165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98185e51-f912-4948-8329-30a6bb345383 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:46.432401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98185e51-f912-4948-8329-30a6bb345383 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:46.470264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1521d-fcea-4c55-8e29-9d04d1e0471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:46.471350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1521d-fcea-4c55-8e29-9d04d1e0471e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:46.471827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1521d-fcea-4c55-8e29-9d04d1e0471e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:46.472399 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1521d-fcea-4c55-8e29-9d04d1e0471e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:46.483336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1521d-fcea-4c55-8e29-9d04d1e0471e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-4de1521d-fcea-4c55-8e29-9d04d1e0471e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:46.491295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:46.492196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:53:46.493022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:46.495616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 423/835] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:53:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:46.501159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898c424-275d-4424-a1c5-c17ce85d8fdd None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:46.606543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898c424-275d-4424-a1c5-c17ce85d8fdd None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:46.645121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3a653-1d54-4710-8fed-4587d348cc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:46.646162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3a653-1d54-4710-8fed-4587d348cc0c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:46.646670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3a653-1d54-4710-8fed-4587d348cc0c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:46.647159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3a653-1d54-4710-8fed-4587d348cc0c None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:46.648104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3a653-1d54-4710-8fed-4587d348cc0c None admin] RBAC: Adding query filter params (name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:46.648641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3a653-1d54-4710-8fed-4587d348cc0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:46.650203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3a653-1d54-4710-8fed-4587d348cc0c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:46.659690 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 413/836] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:53:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:46.664876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1521d-fcea-4c55-8e29-9d04d1e0471e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:46.775787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1521d-fcea-4c55-8e29-9d04d1e0471e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:46.809440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d5127-8d16-495e-9b96-53f98db73fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:46.810224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5127-8d16-495e-9b96-53f98db73fb4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:46.810756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5127-8d16-495e-9b96-53f98db73fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:46.811026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5127-8d16-495e-9b96-53f98db73fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:46.822106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d5127-8d16-495e-9b96-53f98db73fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:46.823609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d5127-8d16-495e-9b96-53f98db73fb4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-000d5127-8d16-495e-9b96-53f98db73fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:46.841392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:46.842318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:46.843918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:46.843918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:46.843918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:46.843918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:46.843918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 424/837] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:46.848984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3a653-1d54-4710-8fed-4587d348cc0c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:46.951959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3a653-1d54-4710-8fed-4587d348cc0c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:46.986334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e497ef-2569-407b-af24-d585e98bf67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:46.987397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e497ef-2569-407b-af24-d585e98bf67d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:46.987935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e497ef-2569-407b-af24-d585e98bf67d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:46.988464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e497ef-2569-407b-af24-d585e98bf67d None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:46.989385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e497ef-2569-407b-af24-d585e98bf67d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:46.989928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e497ef-2569-407b-af24-d585e98bf67d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:46.991497 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e497ef-2569-407b-af24-d585e98bf67d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:47.004854 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 414/838] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:47.016308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d5127-8d16-495e-9b96-53f98db73fb4 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:47.130827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d5127-8d16-495e-9b96-53f98db73fb4 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:47.166079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c556a-2339-42ad-97b6-902e5a912ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:47.166889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c556a-2339-42ad-97b6-902e5a912ecf None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.167175 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c556a-2339-42ad-97b6-902e5a912ecf None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.167453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c556a-2339-42ad-97b6-902e5a912ecf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.176527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c556a-2339-42ad-97b6-902e5a912ecf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:47.177999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c556a-2339-42ad-97b6-902e5a912ecf None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-280c556a-2339-42ad-97b6-902e5a912ecf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:47.194373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:47.195324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:47.196264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:47.196264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:47.196264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:47.196264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:47.196264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:47.196264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:47.196264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:47.196264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:47.196264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:53:47.196264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:47.196264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 425/839] 10.222.0.58 () {56 vars in 1117 bytes} [Tue May 17 11:53:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:47.203162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e497ef-2569-407b-af24-d585e98bf67d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:47.278292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87a69-a4b1-4b6e-a32a-234215a62929 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.278803 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87a69-a4b1-4b6e-a32a-234215a62929 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.278877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87a69-a4b1-4b6e-a32a-234215a62929 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.281388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 426/840] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:53:47.286680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a88c-42c9-467d-9e14-dd1ca76a5e32 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.286970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a88c-42c9-467d-9e14-dd1ca76a5e32 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.287256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0a88c-42c9-467d-9e14-dd1ca76a5e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.306504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-e6f0a88c-42c9-467d-9e14-dd1ca76a5e32 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:47.307684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e6f0a88c-42c9-467d-9e14-dd1ca76a5e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:47.310833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e497ef-2569-407b-af24-d585e98bf67d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:47.346804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da57f2-2fa0-4b5b-b4c3-31cddd01340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:47.347837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da57f2-2fa0-4b5b-b4c3-31cddd01340f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.348348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da57f2-2fa0-4b5b-b4c3-31cddd01340f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.348818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da57f2-2fa0-4b5b-b4c3-31cddd01340f None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.349884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da57f2-2fa0-4b5b-b4c3-31cddd01340f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:47.350408 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da57f2-2fa0-4b5b-b4c3-31cddd01340f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:47.352031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da57f2-2fa0-4b5b-b4c3-31cddd01340f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:47.371438 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 415/841] 10.222.0.58 () {56 vars in 1149 bytes} [Tue May 17 11:53:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:47.377885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da57f2-2fa0-4b5b-b4c3-31cddd01340f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:47.388365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 427/842] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:53:47.404096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0a88c-42c9-467d-9e14-dd1ca76a5e32 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:47.477813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da57f2-2fa0-4b5b-b4c3-31cddd01340f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:47.510087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0a88c-42c9-467d-9e14-dd1ca76a5e32 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:47.514166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dabef-1927-47a5-99eb-91ccb41d9c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:47.515923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dabef-1927-47a5-99eb-91ccb41d9c5f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.516462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dabef-1927-47a5-99eb-91ccb41d9c5f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.516939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dabef-1927-47a5-99eb-91ccb41d9c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.549643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea898d1-185c-4e5f-bbc7-c8ff7dee02ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:47.550419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea898d1-185c-4e5f-bbc7-c8ff7dee02ba None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.550704 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea898d1-185c-4e5f-bbc7-c8ff7dee02ba None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.550980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea898d1-185c-4e5f-bbc7-c8ff7dee02ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.563249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea898d1-185c-4e5f-bbc7-c8ff7dee02ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-dea898d1-185c-4e5f-bbc7-c8ff7dee02ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:47.571075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:47.571992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:53:47.573122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:47.576536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 428/843] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:47.578644 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea898d1-185c-4e5f-bbc7-c8ff7dee02ba None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:47.593158 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dabef-1927-47a5-99eb-91ccb41d9c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:47.594896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dabef-1927-47a5-99eb-91ccb41d9c5f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:47.693116 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea898d1-185c-4e5f-bbc7-c8ff7dee02ba None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:47.704062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 416/844] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 11:53:47.705284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dabef-1927-47a5-99eb-91ccb41d9c5f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:47.731102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25199d9-dd38-4e7a-be11-41372541ce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:47.732304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25199d9-dd38-4e7a-be11-41372541ce34 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.732836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25199d9-dd38-4e7a-be11-41372541ce34 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.733888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25199d9-dd38-4e7a-be11-41372541ce34 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.734951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25199d9-dd38-4e7a-be11-41372541ce34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:47.735350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25199d9-dd38-4e7a-be11-41372541ce34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:47.737004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25199d9-dd38-4e7a-be11-41372541ce34 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:47.747230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 429/845] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:47.748541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29289a14-3c42-429d-b853-d060d473f6fd None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.749977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29289a14-3c42-429d-b853-d060d473f6fd None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.750267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29289a14-3c42-429d-b853-d060d473f6fd None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.751680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 430/846] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:47.753759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29289a14-3c42-429d-b853-d060d473f6fd None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:47.812041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dabef-1927-47a5-99eb-91ccb41d9c5f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:47.847704 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7de37-83ac-44dc-acac-d5afd33eeeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:47.848518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7de37-83ac-44dc-acac-d5afd33eeeb4 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.848800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7de37-83ac-44dc-acac-d5afd33eeeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.849074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7de37-83ac-44dc-acac-d5afd33eeeb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.853792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29289a14-3c42-429d-b853-d060d473f6fd None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:47.858642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7de37-83ac-44dc-acac-d5afd33eeeb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:47.860067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7de37-83ac-44dc-acac-d5afd33eeeb4 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-81c7de37-83ac-44dc-acac-d5afd33eeeb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:47.877429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:47.878423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:47.879306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:47.879306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:47.879306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:47.879306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:47.879306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 417/847] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:47.879809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9928-5c2a-4ca2-b7f1-ade7de26f8e4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.880089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9928-5c2a-4ca2-b7f1-ade7de26f8e4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.880386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9928-5c2a-4ca2-b7f1-ade7de26f8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.891558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d818765-0020-4e9f-9588-a228b9c5b2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:47.892386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d818765-0020-4e9f-9588-a228b9c5b2f1 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.892673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d818765-0020-4e9f-9588-a228b9c5b2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.892952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d818765-0020-4e9f-9588-a228b9c5b2f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.896764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f05a9928-5c2a-4ca2-b7f1-ade7de26f8e4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:47.897912 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f05a9928-5c2a-4ca2-b7f1-ade7de26f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:47.903125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d818765-0020-4e9f-9588-a228b9c5b2f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:47.904600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d818765-0020-4e9f-9588-a228b9c5b2f1 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-2d818765-0020-4e9f-9588-a228b9c5b2f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:47.921747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:47.922793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:47.923859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:47.923859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:47.923859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:47.923859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:47.923859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 431/848] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:47.924246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66650ab2-ab92-46e3-974c-aa4f6b7f1fd8 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:47.924435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66650ab2-ab92-46e3-974c-aa4f6b7f1fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:47.924829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66650ab2-ab92-46e3-974c-aa4f6b7f1fd8 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:47.928858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 432/849] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:47.928858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66650ab2-ab92-46e3-974c-aa4f6b7f1fd8 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:47.965658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 418/850] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:47.966414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a9928-5c2a-4ca2-b7f1-ade7de26f8e4 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.028718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66650ab2-ab92-46e3-974c-aa4f6b7f1fd8 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.058549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a9928-5c2a-4ca2-b7f1-ade7de26f8e4 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.062164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af7e9c-d4f0-4b4c-a73b-adb473ca1657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.062822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7e9c-d4f0-4b4c-a73b-adb473ca1657 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.063107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7e9c-d4f0-4b4c-a73b-adb473ca1657 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.063384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7e9c-d4f0-4b4c-a73b-adb473ca1657 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.064104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7e9c-d4f0-4b4c-a73b-adb473ca1657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:48.064445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7e9c-d4f0-4b4c-a73b-adb473ca1657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.065824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7e9c-d4f0-4b4c-a73b-adb473ca1657 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.078058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 433/851] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:48.079266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e9a87-ef64-4317-b8b4-d96c899440b2 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.079556 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e9a87-ef64-4317-b8b4-d96c899440b2 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.079837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e9a87-ef64-4317-b8b4-d96c899440b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.091650 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0853eb0-b3a4-47aa-a025-57d550335694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.092391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853eb0-b3a4-47aa-a025-57d550335694 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.093203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853eb0-b3a4-47aa-a025-57d550335694 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.093502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853eb0-b3a4-47aa-a025-57d550335694 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.094213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0853eb0-b3a4-47aa-a025-57d550335694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:48.094515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0853eb0-b3a4-47aa-a025-57d550335694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.095866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0853eb0-b3a4-47aa-a025-57d550335694 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.097035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-389e9a87-ef64-4317-b8b4-d96c899440b2 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:48.098219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-389e9a87-ef64-4317-b8b4-d96c899440b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:48.106962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 419/852] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:48.107736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0853eb0-b3a4-47aa-a025-57d550335694 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.163477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 434/853] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:48.164352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e9a87-ef64-4317-b8b4-d96c899440b2 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.203897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0853eb0-b3a4-47aa-a025-57d550335694 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.235151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd8c96-48ba-4772-90dd-6bef231cc519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.235882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8c96-48ba-4772-90dd-6bef231cc519 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.236153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8c96-48ba-4772-90dd-6bef231cc519 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.236447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8c96-48ba-4772-90dd-6bef231cc519 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.237091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd8c96-48ba-4772-90dd-6bef231cc519 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.238440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd8c96-48ba-4772-90dd-6bef231cc519 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-1ccd8c96-48ba-4772-90dd-6bef231cc519 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:48.249885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:48.250974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:48.251793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 420/854] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:48.252615 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd8c96-48ba-4772-90dd-6bef231cc519 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.268480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e9a87-ef64-4317-b8b4-d96c899440b2 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.301866 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0704d5d-9167-4a82-b39d-9cf295ef82f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.302768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704d5d-9167-4a82-b39d-9cf295ef82f7 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.303061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704d5d-9167-4a82-b39d-9cf295ef82f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.303335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704d5d-9167-4a82-b39d-9cf295ef82f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.309883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0704d5d-9167-4a82-b39d-9cf295ef82f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.312172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0704d5d-9167-4a82-b39d-9cf295ef82f7 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-b0704d5d-9167-4a82-b39d-9cf295ef82f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:48.325707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:48.326802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:48.333110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:48.333110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:48.333110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:48.333110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:48.333110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:48.333110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:48.333110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:48.333110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:48.333110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 435/855] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:48.333110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0704d5d-9167-4a82-b39d-9cf295ef82f7 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.345248 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd8c96-48ba-4772-90dd-6bef231cc519 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.377481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa9cd3-0fcb-43a5-b84f-7dd2948b1759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.378259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa9cd3-0fcb-43a5-b84f-7dd2948b1759 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.378539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa9cd3-0fcb-43a5-b84f-7dd2948b1759 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.378811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa9cd3-0fcb-43a5-b84f-7dd2948b1759 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.385986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa9cd3-0fcb-43a5-b84f-7dd2948b1759 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.387410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa9cd3-0fcb-43a5-b84f-7dd2948b1759 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-11fa9cd3-0fcb-43a5-b84f-7dd2948b1759 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:48.401806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:48.402731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:48.403670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:48.403670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:48.403670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:48.403670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:48.403670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:48.403670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:48.403670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:48.403670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:48.403670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 11:53:48.403670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:48.403670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 421/856] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:48.404273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa9cd3-0fcb-43a5-b84f-7dd2948b1759 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.425043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0704d5d-9167-4a82-b39d-9cf295ef82f7 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.467352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941d45d-94e7-4b24-8644-2a14a24a7b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.468200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941d45d-94e7-4b24-8644-2a14a24a7b4d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.468485 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941d45d-94e7-4b24-8644-2a14a24a7b4d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.468778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941d45d-94e7-4b24-8644-2a14a24a7b4d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.469440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941d45d-94e7-4b24-8644-2a14a24a7b4d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.470863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941d45d-94e7-4b24-8644-2a14a24a7b4d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-1941d45d-94e7-4b24-8644-2a14a24a7b4d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:48.483427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:48.484481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:48.485373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 436/857] 10.222.0.58 () {56 vars in 1132 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:48.486220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941d45d-94e7-4b24-8644-2a14a24a7b4d None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.497974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa9cd3-0fcb-43a5-b84f-7dd2948b1759 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.530582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69d3cb-cfb5-4396-93a8-47a17ffb5dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.531183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69d3cb-cfb5-4396-93a8-47a17ffb5dba None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.531486 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69d3cb-cfb5-4396-93a8-47a17ffb5dba None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.531759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69d3cb-cfb5-4396-93a8-47a17ffb5dba None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.532498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69d3cb-cfb5-4396-93a8-47a17ffb5dba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:48.532805 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69d3cb-cfb5-4396-93a8-47a17ffb5dba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.534171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69d3cb-cfb5-4396-93a8-47a17ffb5dba None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.538540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 422/858] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:48.539311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69d3cb-cfb5-4396-93a8-47a17ffb5dba None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.588345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941d45d-94e7-4b24-8644-2a14a24a7b4d None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.618861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f02075-9634-402f-84a1-5e2f2e7ea856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.619505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f02075-9634-402f-84a1-5e2f2e7ea856 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.619784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f02075-9634-402f-84a1-5e2f2e7ea856 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.620053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f02075-9634-402f-84a1-5e2f2e7ea856 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.620843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f02075-9634-402f-84a1-5e2f2e7ea856 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:48.621147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f02075-9634-402f-84a1-5e2f2e7ea856 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.622555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f02075-9634-402f-84a1-5e2f2e7ea856 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.633298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69d3cb-cfb5-4396-93a8-47a17ffb5dba None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.634324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 437/859] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:48.635107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f02075-9634-402f-84a1-5e2f2e7ea856 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.665600 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec57c-1591-4e96-a34b-cb976e3b3d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.666262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec57c-1591-4e96-a34b-cb976e3b3d7e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.666546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec57c-1591-4e96-a34b-cb976e3b3d7e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.666819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec57c-1591-4e96-a34b-cb976e3b3d7e None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.667649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ec57c-1591-4e96-a34b-cb976e3b3d7e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:48.667961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ec57c-1591-4e96-a34b-cb976e3b3d7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.669415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ec57c-1591-4e96-a34b-cb976e3b3d7e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.687051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 423/860] 10.222.0.58 () {56 vars in 1135 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:48.687914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec57c-1591-4e96-a34b-cb976e3b3d7e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.733709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f02075-9634-402f-84a1-5e2f2e7ea856 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.766332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0344a6-252a-478d-a675-21aaedcb4f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.766928 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0344a6-252a-478d-a675-21aaedcb4f76 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.767213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0344a6-252a-478d-a675-21aaedcb4f76 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.767490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0344a6-252a-478d-a675-21aaedcb4f76 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.768209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0344a6-252a-478d-a675-21aaedcb4f76 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:48.768525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0344a6-252a-478d-a675-21aaedcb4f76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.769916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0344a6-252a-478d-a675-21aaedcb4f76 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.774237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 438/861] 10.222.0.58 () {56 vars in 1126 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:48.775004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0344a6-252a-478d-a675-21aaedcb4f76 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.786105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec57c-1591-4e96-a34b-cb976e3b3d7e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.830532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e188bd-ae3b-43ce-b871-8d18c5957b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.831196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e188bd-ae3b-43ce-b871-8d18c5957b4c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.831478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e188bd-ae3b-43ce-b871-8d18c5957b4c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.831751 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e188bd-ae3b-43ce-b871-8d18c5957b4c None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.832482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e188bd-ae3b-43ce-b871-8d18c5957b4c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:48.832786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e188bd-ae3b-43ce-b871-8d18c5957b4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.834157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e188bd-ae3b-43ce-b871-8d18c5957b4c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.839232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 424/862] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:48.840231 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e188bd-ae3b-43ce-b871-8d18c5957b4c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.884550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0344a6-252a-478d-a675-21aaedcb4f76 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:48.920155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354b5ac-0dd9-4dc5-9c01-ce814991a09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:48.921359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b5ac-0dd9-4dc5-9c01-ce814991a09b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:48.921635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b5ac-0dd9-4dc5-9c01-ce814991a09b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:48.921910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b5ac-0dd9-4dc5-9c01-ce814991a09b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:48.922746 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354b5ac-0dd9-4dc5-9c01-ce814991a09b None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=1fbb465d777c4f02b7777ad154d09c8c) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:48.923055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354b5ac-0dd9-4dc5-9c01-ce814991a09b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:48.924533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354b5ac-0dd9-4dc5-9c01-ce814991a09b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:48.930874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 439/863] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/role_assignments?user.id=1fbb465d777c4f02b7777ad154d09c8c&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:48.931990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354b5ac-0dd9-4dc5-9c01-ce814991a09b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:48.957971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e188bd-ae3b-43ce-b871-8d18c5957b4c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:49.008678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247b74-9ad4-4003-a6b3-72bb4124b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:49.010324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247b74-9ad4-4003-a6b3-72bb4124b4ce None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:49.010793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247b74-9ad4-4003-a6b3-72bb4124b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:49.011214 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247b74-9ad4-4003-a6b3-72bb4124b4ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:49.052870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354b5ac-0dd9-4dc5-9c01-ce814991a09b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:49.103193 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87af7d4-f130-4ab0-bb1f-0645923e6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:49.103941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87af7d4-f130-4ab0-bb1f-0645923e6bff None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:49.104317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87af7d4-f130-4ab0-bb1f-0645923e6bff None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:49.104429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7247b74-9ad4-4003-a6b3-72bb4124b4ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:49.104586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87af7d4-f130-4ab0-bb1f-0645923e6bff None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:49.105305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87af7d4-f130-4ab0-bb1f-0645923e6bff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:49.105609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87af7d4-f130-4ab0-bb1f-0645923e6bff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:49.106486 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7247b74-9ad4-4003-a6b3-72bb4124b4ce None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:49.106992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87af7d4-f130-4ab0-bb1f-0645923e6bff None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:49.112880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 440/864] 10.222.0.58 () {56 vars in 1126 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:49.225914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 425/865] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:53:49.231794 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87af7d4-f130-4ab0-bb1f-0645923e6bff None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:49.338324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87af7d4-f130-4ab0-bb1f-0645923e6bff None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:49.373432 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eae28c-cf03-40e6-a804-458369d22f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:49.375061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae28c-cf03-40e6-a804-458369d22f85 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:49.375521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae28c-cf03-40e6-a804-458369d22f85 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:49.375968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eae28c-cf03-40e6-a804-458369d22f85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:49.386854 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eae28c-cf03-40e6-a804-458369d22f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:49.388638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eae28c-cf03-40e6-a804-458369d22f85 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-29eae28c-cf03-40e6-a804-458369d22f85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:49.407477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:49.408431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:49.409302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:49.409302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:49.409302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:49.409302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:49.411285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 441/866] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:49.417002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247b74-9ad4-4003-a6b3-72bb4124b4ce None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:49.519412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247b74-9ad4-4003-a6b3-72bb4124b4ce None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:49.554522 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b4996-e968-40e2-b787-453737885678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:49.555196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4996-e968-40e2-b787-453737885678 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:49.555475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4996-e968-40e2-b787-453737885678 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:49.555751 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b4996-e968-40e2-b787-453737885678 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:49.556580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b4996-e968-40e2-b787-453737885678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:49.556887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b4996-e968-40e2-b787-453737885678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:49.558247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b4996-e968-40e2-b787-453737885678 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:49.570240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 426/867] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:49.575676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eae28c-cf03-40e6-a804-458369d22f85 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:49.677122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eae28c-cf03-40e6-a804-458369d22f85 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:49.712194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012052ab-a25e-482a-846e-fe07ffa0663e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:49.713043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012052ab-a25e-482a-846e-fe07ffa0663e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:49.713413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012052ab-a25e-482a-846e-fe07ffa0663e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:49.713686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012052ab-a25e-482a-846e-fe07ffa0663e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:49.721638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012052ab-a25e-482a-846e-fe07ffa0663e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:49.723160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012052ab-a25e-482a-846e-fe07ffa0663e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-012052ab-a25e-482a-846e-fe07ffa0663e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:49.739532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:49.740471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:49.741346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:49.741346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:49.741346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:49.741346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:49.741346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:49.741346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:49.741346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:49.741346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:49.741346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 442/868] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:49.746675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b4996-e968-40e2-b787-453737885678 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:49.846969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b4996-e968-40e2-b787-453737885678 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:49.881084 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e3392-6db8-485c-a48c-d2f9bae3f9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:49.881748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3392-6db8-485c-a48c-d2f9bae3f9d6 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:49.882027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3392-6db8-485c-a48c-d2f9bae3f9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:49.882298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3392-6db8-485c-a48c-d2f9bae3f9d6 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:49.883083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e3392-6db8-485c-a48c-d2f9bae3f9d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:49.883391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e3392-6db8-485c-a48c-d2f9bae3f9d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:49.884844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e3392-6db8-485c-a48c-d2f9bae3f9d6 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:49.897786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 427/869] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:49.903630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012052ab-a25e-482a-846e-fe07ffa0663e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:50.006836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012052ab-a25e-482a-846e-fe07ffa0663e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:50.041703 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69a71b-e854-421f-bf28-ea12e2a3d593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:50.042468 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69a71b-e854-421f-bf28-ea12e2a3d593 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:50.042755 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69a71b-e854-421f-bf28-ea12e2a3d593 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:50.043030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69a71b-e854-421f-bf28-ea12e2a3d593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:50.043868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69a71b-e854-421f-bf28-ea12e2a3d593 None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=5206e8bbb04042f4b00637518f297a97) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:50.044194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69a71b-e854-421f-bf28-ea12e2a3d593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:50.045920 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69a71b-e854-421f-bf28-ea12e2a3d593 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:50.052513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 443/870] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:49 2022] GET /identity/v3/role_assignments?user.id=5206e8bbb04042f4b00637518f297a97&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=3db33dfd3d6544fd81933007633fc56a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:51.180662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a6464-5a3d-4c3f-9607-dcaa9c59ed97 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:51.181187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a6464-5a3d-4c3f-9607-dcaa9c59ed97 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:51.181187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a6464-5a3d-4c3f-9607-dcaa9c59ed97 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:51.182682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 428/871] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:51.188499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d8fdb-2661-4d36-92f2-2419cbaca5c9 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:51.189300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d8fdb-2661-4d36-92f2-2419cbaca5c9 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:51.189787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d8fdb-2661-4d36-92f2-2419cbaca5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:51.208392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-5f2d8fdb-2661-4d36-92f2-2419cbaca5c9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:51.209991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5f2d8fdb-2661-4d36-92f2-2419cbaca5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:51.276816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec24e-bb4d-4163-8838-9fcabae20546 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:51.277127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec24e-bb4d-4163-8838-9fcabae20546 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:51.277367 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec24e-bb4d-4163-8838-9fcabae20546 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:51.283718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 429/872] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:51.284892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1829-40de-438c-857e-4de5d596e94f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:51.285176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1829-40de-438c-857e-4de5d596e94f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:51.285451 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e1829-40de-438c-857e-4de5d596e94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:51.286071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 444/873] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:53:51.302999 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-448e1829-40de-438c-857e-4de5d596e94f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:51.304155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-448e1829-40de-438c-857e-4de5d596e94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:51.309256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d8fdb-2661-4d36-92f2-2419cbaca5c9 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:51.385294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 430/874] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:51.409016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e1829-40de-438c-857e-4de5d596e94f None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:51.414160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d8fdb-2661-4d36-92f2-2419cbaca5c9 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:51.449245 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682c5c5-56c7-4f17-84ed-2dcb72c88594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:51.449826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682c5c5-56c7-4f17-84ed-2dcb72c88594 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:51.450105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682c5c5-56c7-4f17-84ed-2dcb72c88594 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:51.450375 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682c5c5-56c7-4f17-84ed-2dcb72c88594 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:51.451155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682c5c5-56c7-4f17-84ed-2dcb72c88594 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:51.453126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682c5c5-56c7-4f17-84ed-2dcb72c88594 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:51.468336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 445/875] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:53:51 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:53:51.470154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d02f17-3a8a-425d-b10d-0487d30bfb3f None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:51.470466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d02f17-3a8a-425d-b10d-0487d30bfb3f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:51.470742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d02f17-3a8a-425d-b10d-0487d30bfb3f None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:51.472344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 446/876] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:51.478572 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386291-8f64-477d-8f71-458df67d5768 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:51.479008 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386291-8f64-477d-8f71-458df67d5768 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:51.479275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386291-8f64-477d-8f71-458df67d5768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:51.502540 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-d7386291-8f64-477d-8f71-458df67d5768 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:51.504230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-d7386291-8f64-477d-8f71-458df67d5768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:51.540134 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e1829-40de-438c-857e-4de5d596e94f None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:51.584536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287dd9e-fd5d-4417-9e95-6a1e520a9166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:51.585393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287dd9e-fd5d-4417-9e95-6a1e520a9166 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:51.585676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287dd9e-fd5d-4417-9e95-6a1e520a9166 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:51.585959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287dd9e-fd5d-4417-9e95-6a1e520a9166 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:51.598122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287dd9e-fd5d-4417-9e95-6a1e520a9166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:51.604480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 447/877] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-7287dd9e-fd5d-4417-9e95-6a1e520a9166 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:51.612402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:51.613377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:51.614176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 431/878] 10.222.0.58 () {56 vars in 1120 bytes} [Tue May 17 11:53:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:51.614850 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287dd9e-fd5d-4417-9e95-6a1e520a9166 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:51.635568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7386291-8f64-477d-8f71-458df67d5768 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:51.727550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287dd9e-fd5d-4417-9e95-6a1e520a9166 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:51.753423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7386291-8f64-477d-8f71-458df67d5768 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:51.772127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36af27b-b164-4b27-aee2-8758e152270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:51.773193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36af27b-b164-4b27-aee2-8758e152270e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:51.773549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36af27b-b164-4b27-aee2-8758e152270e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:51.773895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36af27b-b164-4b27-aee2-8758e152270e None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:51.774883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36af27b-b164-4b27-aee2-8758e152270e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:51.775262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36af27b-b164-4b27-aee2-8758e152270e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:51.777040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36af27b-b164-4b27-aee2-8758e152270e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:51.789808 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 432/879] 10.222.0.58 () {56 vars in 1115 bytes} [Tue May 17 11:53:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:51.797274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36af27b-b164-4b27-aee2-8758e152270e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:51.802175 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b9511-058d-4f13-abb7-be10ce154b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:51.803058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b9511-058d-4f13-abb7-be10ce154b6f None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:51.803482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b9511-058d-4f13-abb7-be10ce154b6f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:51.803898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b9511-058d-4f13-abb7-be10ce154b6f None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:51.804858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b9511-058d-4f13-abb7-be10ce154b6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:51.806393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b9511-058d-4f13-abb7-be10ce154b6f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:51.829503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 448/880] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:53:51 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:53:51.923382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36af27b-b164-4b27-aee2-8758e152270e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:51.966696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5811766-ba27-42a0-b04d-802ed97d3298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:51.967786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5811766-ba27-42a0-b04d-802ed97d3298 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:51.968273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5811766-ba27-42a0-b04d-802ed97d3298 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:51.968746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5811766-ba27-42a0-b04d-802ed97d3298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:51.981265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5811766-ba27-42a0-b04d-802ed97d3298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:51.983547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5811766-ba27-42a0-b04d-802ed97d3298 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-d5811766-ba27-42a0-b04d-802ed97d3298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:52.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:52.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:52.004879 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:52.004879 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:52.004879 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:52.004879 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:52.006794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 433/881] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:52.012542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b9511-058d-4f13-abb7-be10ce154b6f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:52.118429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b9511-058d-4f13-abb7-be10ce154b6f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:52.151246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d891b-4b97-4f02-a31d-d03c8f4e2c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:52.151917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d891b-4b97-4f02-a31d-d03c8f4e2c18 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:52.152212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d891b-4b97-4f02-a31d-d03c8f4e2c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:52.152489 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d891b-4b97-4f02-a31d-d03c8f4e2c18 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:52.153211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d891b-4b97-4f02-a31d-d03c8f4e2c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:52.153519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d891b-4b97-4f02-a31d-d03c8f4e2c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:52.155527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d891b-4b97-4f02-a31d-d03c8f4e2c18 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:52.167818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 449/882] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:52.173975 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5811766-ba27-42a0-b04d-802ed97d3298 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:52.280566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5811766-ba27-42a0-b04d-802ed97d3298 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:52.318618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90474cf6-68c9-4fc9-b06a-89bf15be3162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:52.319863 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90474cf6-68c9-4fc9-b06a-89bf15be3162 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:52.320415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90474cf6-68c9-4fc9-b06a-89bf15be3162 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:52.320888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90474cf6-68c9-4fc9-b06a-89bf15be3162 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:52.329751 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90474cf6-68c9-4fc9-b06a-89bf15be3162 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:52.331485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90474cf6-68c9-4fc9-b06a-89bf15be3162 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-90474cf6-68c9-4fc9-b06a-89bf15be3162 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:52.346567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:52.347556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:52.348521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:52.348521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:52.348521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:52.348521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:52.348521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:52.348521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:52.348521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:52.348521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:52.348521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:53:52.348521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:52.351233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 434/883] 10.222.0.58 () {56 vars in 1117 bytes} [Tue May 17 11:53:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:52.357070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d891b-4b97-4f02-a31d-d03c8f4e2c18 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:52.370652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0804d4-d6af-405c-8337-a733f170fa08 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:52.370946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0804d4-d6af-405c-8337-a733f170fa08 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:52.371209 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0804d4-d6af-405c-8337-a733f170fa08 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:52.374454 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 435/884] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:53:52.381545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b35aba-4a62-4170-859e-21793a3a8261 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:52.381834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b35aba-4a62-4170-859e-21793a3a8261 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:52.382104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b35aba-4a62-4170-859e-21793a3a8261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:52.399686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-61b35aba-4a62-4170-859e-21793a3a8261 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:52.400891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-61b35aba-4a62-4170-859e-21793a3a8261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:52.482447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 436/885] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:53:52.489271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d891b-4b97-4f02-a31d-d03c8f4e2c18 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:52.504695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b35aba-4a62-4170-859e-21793a3a8261 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:52.528285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3951eb-a2bd-4df3-bac8-a45d356e7ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:52.528968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3951eb-a2bd-4df3-bac8-a45d356e7ef6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:52.529249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3951eb-a2bd-4df3-bac8-a45d356e7ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:52.529522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3951eb-a2bd-4df3-bac8-a45d356e7ef6 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:52.531342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3951eb-a2bd-4df3-bac8-a45d356e7ef6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:52.531605 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3951eb-a2bd-4df3-bac8-a45d356e7ef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:52.533367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3951eb-a2bd-4df3-bac8-a45d356e7ef6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:52.559689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 450/886] 10.222.0.58 () {56 vars in 1149 bytes} [Tue May 17 11:53:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:52.561511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3951eb-a2bd-4df3-bac8-a45d356e7ef6 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:52.627082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b35aba-4a62-4170-859e-21793a3a8261 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:52.669234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab295c-a171-4f76-83a6-959f5df4f83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:52.670973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab295c-a171-4f76-83a6-959f5df4f83c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:52.671488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab295c-a171-4f76-83a6-959f5df4f83c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:52.672093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab295c-a171-4f76-83a6-959f5df4f83c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:52.673703 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab295c-a171-4f76-83a6-959f5df4f83c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:52.675937 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab295c-a171-4f76-83a6-959f5df4f83c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:52.678847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3951eb-a2bd-4df3-bac8-a45d356e7ef6 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-a3ab295c-a171-4f76-83a6-959f5df4f83c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:52.693183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:52.694255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:53:52.695089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:52.700230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 437/887] 10.222.0.58 () {56 vars in 1126 bytes} [Tue May 17 11:53:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:52.704594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab295c-a171-4f76-83a6-959f5df4f83c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:52.722844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129e9d1-da56-4658-a288-186638373234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:52.723679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129e9d1-da56-4658-a288-186638373234 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:52.724105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129e9d1-da56-4658-a288-186638373234 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:52.724519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129e9d1-da56-4658-a288-186638373234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:52.798417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129e9d1-da56-4658-a288-186638373234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:52.799959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129e9d1-da56-4658-a288-186638373234 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:52.829424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab295c-a171-4f76-83a6-959f5df4f83c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:52.881707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c456-1918-452e-8e86-65e1e6f4c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:52.882613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c456-1918-452e-8e86-65e1e6f4c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:52.883061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c456-1918-452e-8e86-65e1e6f4c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:52.883475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c456-1918-452e-8e86-65e1e6f4c4e8 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:52.884738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484c456-1918-452e-8e86-65e1e6f4c4e8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:52.885208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484c456-1918-452e-8e86-65e1e6f4c4e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:52.887079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484c456-1918-452e-8e86-65e1e6f4c4e8 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:52.893696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 438/888] 10.222.0.58 () {56 vars in 1122 bytes} [Tue May 17 11:53:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:52.899707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c456-1918-452e-8e86-65e1e6f4c4e8 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:52.926780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 451/889] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:53:52 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 11:53:52.928096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129e9d1-da56-4658-a288-186638373234 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:53.021345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c456-1918-452e-8e86-65e1e6f4c4e8 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:53.047708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129e9d1-da56-4658-a288-186638373234 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:53.059319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d0b7d-8073-4300-a9f0-1cec3602888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:53.059993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d0b7d-8073-4300-a9f0-1cec3602888d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:53.060387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d0b7d-8073-4300-a9f0-1cec3602888d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:53.060914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d0b7d-8073-4300-a9f0-1cec3602888d None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:53.062432 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d0b7d-8073-4300-a9f0-1cec3602888d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:53.062742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d0b7d-8073-4300-a9f0-1cec3602888d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:53.064113 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d0b7d-8073-4300-a9f0-1cec3602888d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:53.073235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 439/890] 10.222.0.58 () {56 vars in 1122 bytes} [Tue May 17 11:53:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:53.090009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd93bc-5708-4f9a-aa4d-1fb1bfd2ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:53.090885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd93bc-5708-4f9a-aa4d-1fb1bfd2ea94 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:53.091182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd93bc-5708-4f9a-aa4d-1fb1bfd2ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:53.091449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd93bc-5708-4f9a-aa4d-1fb1bfd2ea94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:53.104101 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd93bc-5708-4f9a-aa4d-1fb1bfd2ea94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:53.105641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd93bc-5708-4f9a-aa4d-1fb1bfd2ea94 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-f5bd93bc-5708-4f9a-aa4d-1fb1bfd2ea94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:53.126424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:53.127369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:53.128499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:53.128499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:53.128499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:53.128499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:53.128499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 452/891] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:53.133270 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d0b7d-8073-4300-a9f0-1cec3602888d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:53.245242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d0b7d-8073-4300-a9f0-1cec3602888d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:53.282456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dc8f7-3e64-4562-8478-87f6e5b129bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:53.283220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dc8f7-3e64-4562-8478-87f6e5b129bb None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:53.283403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dc8f7-3e64-4562-8478-87f6e5b129bb None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:53.283681 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dc8f7-3e64-4562-8478-87f6e5b129bb None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:53.285034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dc8f7-3e64-4562-8478-87f6e5b129bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:53.285034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dc8f7-3e64-4562-8478-87f6e5b129bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:53.286100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dc8f7-3e64-4562-8478-87f6e5b129bb None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:53.300224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 440/892] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:53.304463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd93bc-5708-4f9a-aa4d-1fb1bfd2ea94 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:53.410313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd93bc-5708-4f9a-aa4d-1fb1bfd2ea94 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:53.448488 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7e141-f216-47db-a7bf-af409787592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:53.449282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7e141-f216-47db-a7bf-af409787592d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:53.449569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7e141-f216-47db-a7bf-af409787592d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:53.449846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7e141-f216-47db-a7bf-af409787592d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:53.457508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7e141-f216-47db-a7bf-af409787592d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:53.459035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7e141-f216-47db-a7bf-af409787592d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-56c7e141-f216-47db-a7bf-af409787592d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:53.473338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:53.474349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:53.475270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:53.475270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:53.475270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:53.475270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:53.475270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:53.475270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:53.475270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:53.475270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:53.475270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 453/893] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:53.481984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dc8f7-3e64-4562-8478-87f6e5b129bb None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:53.594893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dc8f7-3e64-4562-8478-87f6e5b129bb None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:53.629718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73d9ef-35fc-4fdf-aaba-40a2f55a51a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:53.630393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73d9ef-35fc-4fdf-aaba-40a2f55a51a8 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:53.630685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73d9ef-35fc-4fdf-aaba-40a2f55a51a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:53.630963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73d9ef-35fc-4fdf-aaba-40a2f55a51a8 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:53.631760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73d9ef-35fc-4fdf-aaba-40a2f55a51a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:53.632070 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73d9ef-35fc-4fdf-aaba-40a2f55a51a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:53.633536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73d9ef-35fc-4fdf-aaba-40a2f55a51a8 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:53.646227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 441/894] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:53.652010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7e141-f216-47db-a7bf-af409787592d None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:53.763213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7e141-f216-47db-a7bf-af409787592d None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:53.798471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876098f-0037-458e-b21a-02b48e56fdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:53.799135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876098f-0037-458e-b21a-02b48e56fdc4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:53.799422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876098f-0037-458e-b21a-02b48e56fdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:53.799702 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876098f-0037-458e-b21a-02b48e56fdc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:53.800568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876098f-0037-458e-b21a-02b48e56fdc4 None admin] RBAC: Adding query filter params (role.id=06c32961ffa44ca7ab91a257468ae7d4, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=1fbb465d777c4f02b7777ad154d09c8c) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:53.800886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876098f-0037-458e-b21a-02b48e56fdc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:53.802328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876098f-0037-458e-b21a-02b48e56fdc4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:53.808306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 454/895] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:53:53 2022] GET /identity/v3/role_assignments?user.id=1fbb465d777c4f02b7777ad154d09c8c&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=06c32961ffa44ca7ab91a257468ae7d4 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:53.867431 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65891f5-7130-44c8-90a7-97648d3793ab None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:53.867734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65891f5-7130-44c8-90a7-97648d3793ab None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:53.868139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65891f5-7130-44c8-90a7-97648d3793ab None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:53.869741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 442/896] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:53.875698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e749d-0bc5-4c77-a140-585dcfe5da6b None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:53.876349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e749d-0bc5-4c77-a140-585dcfe5da6b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:53.876843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e749d-0bc5-4c77-a140-585dcfe5da6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:53.896783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2d1e749d-0bc5-4c77-a140-585dcfe5da6b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:53.898331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2d1e749d-0bc5-4c77-a140-585dcfe5da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:53.974930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 455/897] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:53.999450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65891f5-7130-44c8-90a7-97648d3793ab None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:54.107381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65891f5-7130-44c8-90a7-97648d3793ab None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:54.142209 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958b6c4-9234-4e62-afe9-240f732fb23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:54.143022 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b6c4-9234-4e62-afe9-240f732fb23b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:54.143306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b6c4-9234-4e62-afe9-240f732fb23b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:54.143586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958b6c4-9234-4e62-afe9-240f732fb23b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:54.144291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958b6c4-9234-4e62-afe9-240f732fb23b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:54.145675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958b6c4-9234-4e62-afe9-240f732fb23b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-5958b6c4-9234-4e62-afe9-240f732fb23b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:54.158978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:54.160033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:54.161306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 443/898] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:54.166625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e749d-0bc5-4c77-a140-585dcfe5da6b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:54.195334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50f85-dfd2-40b7-94b1-303759593b57 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:54.195736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50f85-dfd2-40b7-94b1-303759593b57 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:54.196148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee50f85-dfd2-40b7-94b1-303759593b57 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:54.198122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 444/899] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:54.204348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c955a-b295-497a-abf5-3583ff35f8a1 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:54.204923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c955a-b295-497a-abf5-3583ff35f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:54.205409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c955a-b295-497a-abf5-3583ff35f8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:54.222819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-c00c955a-b295-497a-abf5-3583ff35f8a1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:54.224377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c00c955a-b295-497a-abf5-3583ff35f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:54.297757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e749d-0bc5-4c77-a140-585dcfe5da6b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:54.300225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 445/900] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:53:54.324971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c955a-b295-497a-abf5-3583ff35f8a1 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:54.346933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f3027-9842-48fd-940a-55cbee55e82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:54.347609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f3027-9842-48fd-940a-55cbee55e82f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:54.347889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f3027-9842-48fd-940a-55cbee55e82f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:54.348163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f3027-9842-48fd-940a-55cbee55e82f None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:54.348957 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f3027-9842-48fd-940a-55cbee55e82f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:54.349263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f3027-9842-48fd-940a-55cbee55e82f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:54.351166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f3027-9842-48fd-940a-55cbee55e82f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:54.358217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 456/901] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:54.365339 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f3027-9842-48fd-940a-55cbee55e82f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:54.441700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c955a-b295-497a-abf5-3583ff35f8a1 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:54.478215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ce810-e542-49fc-b8e5-e13d69208137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:54.479067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ce810-e542-49fc-b8e5-e13d69208137 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:54.479291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ce810-e542-49fc-b8e5-e13d69208137 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:54.479564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ce810-e542-49fc-b8e5-e13d69208137 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:54.480253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ce810-e542-49fc-b8e5-e13d69208137 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:54.481630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ce810-e542-49fc-b8e5-e13d69208137 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:54.492398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f3027-9842-48fd-940a-55cbee55e82f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-c32ce810-e542-49fc-b8e5-e13d69208137 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:54.494477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:54.495387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 11:53:54.496227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:54.500478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 446/902] 10.222.0.58 () {56 vars in 1132 bytes} [Tue May 17 11:53:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:54.502285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ce810-e542-49fc-b8e5-e13d69208137 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:54.549904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fdbf7-ee37-4296-adbf-9fb3851c6c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:54.551308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fdbf7-ee37-4296-adbf-9fb3851c6c0a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:54.551811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fdbf7-ee37-4296-adbf-9fb3851c6c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:54.552519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fdbf7-ee37-4296-adbf-9fb3851c6c0a None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:54.553243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fdbf7-ee37-4296-adbf-9fb3851c6c0a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:54.554692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fdbf7-ee37-4296-adbf-9fb3851c6c0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:54.556064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fdbf7-ee37-4296-adbf-9fb3851c6c0a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:54.570013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 457/903] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:54.570901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fdbf7-ee37-4296-adbf-9fb3851c6c0a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:54.626398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ce810-e542-49fc-b8e5-e13d69208137 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:54.660889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd107f-d069-4840-b422-a5d5ce0426fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:54.661543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd107f-d069-4840-b422-a5d5ce0426fc None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:54.661864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd107f-d069-4840-b422-a5d5ce0426fc None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:54.662145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd107f-d069-4840-b422-a5d5ce0426fc None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:54.662860 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd107f-d069-4840-b422-a5d5ce0426fc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:54.663166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd107f-d069-4840-b422-a5d5ce0426fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:54.664627 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd107f-d069-4840-b422-a5d5ce0426fc None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:54.674679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 447/904] 10.222.0.58 () {56 vars in 1126 bytes} [Tue May 17 11:53:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:54.675681 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd107f-d069-4840-b422-a5d5ce0426fc None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:54.695261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fdbf7-ee37-4296-adbf-9fb3851c6c0a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:54.739904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139c387-7a89-4d0e-9a0b-5629e834e069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:54.741105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139c387-7a89-4d0e-9a0b-5629e834e069 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:54.742102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139c387-7a89-4d0e-9a0b-5629e834e069 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:54.742618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139c387-7a89-4d0e-9a0b-5629e834e069 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:54.743853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139c387-7a89-4d0e-9a0b-5629e834e069 None admin] RBAC: Adding query filter params (interface=public, service_id=0f82cfbb03a34cc5a53d74eefe805b8c, region_id=RegionOne) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:54.744548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139c387-7a89-4d0e-9a0b-5629e834e069 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:54.746897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139c387-7a89-4d0e-9a0b-5629e834e069 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:54.754137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 458/905] 10.222.0.58 () {56 vars in 1251 bytes} [Tue May 17 11:53:54 2022] GET /identity/v3/endpoints?service_id=0f82cfbb03a34cc5a53d74eefe805b8c&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:54.759205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139c387-7a89-4d0e-9a0b-5629e834e069 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:54.777958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd107f-d069-4840-b422-a5d5ce0426fc None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:54.813733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9266f-0c18-4a71-ba1d-143b7da6c970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:54.814787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9266f-0c18-4a71-ba1d-143b7da6c970 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:54.815290 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9266f-0c18-4a71-ba1d-143b7da6c970 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:54.815819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9266f-0c18-4a71-ba1d-143b7da6c970 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:54.816800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9266f-0c18-4a71-ba1d-143b7da6c970 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:54.817315 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9266f-0c18-4a71-ba1d-143b7da6c970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:54.818923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9266f-0c18-4a71-ba1d-143b7da6c970 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:54.829044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 448/906] 10.222.0.58 () {56 vars in 1126 bytes} [Tue May 17 11:53:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:54.830199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9266f-0c18-4a71-ba1d-143b7da6c970 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:54.860527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139c387-7a89-4d0e-9a0b-5629e834e069 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:54.896391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cb81a-0294-469e-b65d-be57079082a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:54.897003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cb81a-0294-469e-b65d-be57079082a5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:54.897288 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cb81a-0294-469e-b65d-be57079082a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:54.897660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cb81a-0294-469e-b65d-be57079082a5 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:54.898253 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cb81a-0294-469e-b65d-be57079082a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:54.899629 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cb81a-0294-469e-b65d-be57079082a5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:54.912218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 459/907] 10.222.0.58 () {56 vars in 1087 bytes} [Tue May 17 11:53:54 2022] GET /identity/v3/services => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 11:53:54.946690 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9266f-0c18-4a71-ba1d-143b7da6c970 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:54.988302 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3ac43-8264-4102-90e9-bc53aff15db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:54.989267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3ac43-8264-4102-90e9-bc53aff15db2 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:54.989707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3ac43-8264-4102-90e9-bc53aff15db2 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:54.990140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3ac43-8264-4102-90e9-bc53aff15db2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:54.991120 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3ac43-8264-4102-90e9-bc53aff15db2 None admin] RBAC: Adding query filter params (interface=public, service_id=9e73047ec0794a39aecd8606e596beae, region_id=RegionOne) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:54.991583 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3ac43-8264-4102-90e9-bc53aff15db2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:54.993181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3ac43-8264-4102-90e9-bc53aff15db2 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:55.000339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 449/908] 10.222.0.58 () {56 vars in 1251 bytes} [Tue May 17 11:53:54 2022] GET /identity/v3/endpoints?service_id=9e73047ec0794a39aecd8606e596beae&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:55.009397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cb81a-0294-469e-b65d-be57079082a5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:55.117800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cb81a-0294-469e-b65d-be57079082a5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:55.162414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a469f17-3126-4459-bd31-5f44d9dfaf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:55.163390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a469f17-3126-4459-bd31-5f44d9dfaf40 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:55.163815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a469f17-3126-4459-bd31-5f44d9dfaf40 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:55.164286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a469f17-3126-4459-bd31-5f44d9dfaf40 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:55.165414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a469f17-3126-4459-bd31-5f44d9dfaf40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:55.167161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a469f17-3126-4459-bd31-5f44d9dfaf40 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:55.173631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 460/909] 10.222.0.58 () {56 vars in 1087 bytes} [Tue May 17 11:53:55 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 11:53:55.401203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285681ae-4571-4468-adf0-db11878d5109 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:55.401728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285681ae-4571-4468-adf0-db11878d5109 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:55.401728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285681ae-4571-4468-adf0-db11878d5109 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:55.403335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 450/910] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:55.409192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d570ce5-7ab9-412e-b1d9-6d2edf40b76b None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:55.409485 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d570ce5-7ab9-412e-b1d9-6d2edf40b76b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:55.409768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d570ce5-7ab9-412e-b1d9-6d2edf40b76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:55.428116 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-6d570ce5-7ab9-412e-b1d9-6d2edf40b76b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:55.429634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6d570ce5-7ab9-412e-b1d9-6d2edf40b76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:55.499575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 461/911] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:53:55.522513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285681ae-4571-4468-adf0-db11878d5109 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:55.628433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285681ae-4571-4468-adf0-db11878d5109 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:55.662513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146732b6-289f-416c-83d4-8695aac74936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:55.663541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146732b6-289f-416c-83d4-8695aac74936 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:55.664017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146732b6-289f-416c-83d4-8695aac74936 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:55.664520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146732b6-289f-416c-83d4-8695aac74936 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:55.665471 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146732b6-289f-416c-83d4-8695aac74936 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:55.667020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146732b6-289f-416c-83d4-8695aac74936 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:55.685809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 451/912] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:53:55 2022] POST /identity/v3/services => generated 241 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:53:56.105273 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b815b-a603-426f-8024-42849f0db351 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:56.105462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b815b-a603-426f-8024-42849f0db351 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:56.105748 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b815b-a603-426f-8024-42849f0db351 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:56.107335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 462/913] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:56.113228 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40557db-801d-4275-8e1a-856784fd280f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:56.113527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40557db-801d-4275-8e1a-856784fd280f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:56.113794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40557db-801d-4275-8e1a-856784fd280f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:56.132115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a40557db-801d-4275-8e1a-856784fd280f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:56.133659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a40557db-801d-4275-8e1a-856784fd280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:56.207905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 452/914] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:53:56.229823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b815b-a603-426f-8024-42849f0db351 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:56.336388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b815b-a603-426f-8024-42849f0db351 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:56.372475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67037da-15bb-4860-b3e1-10b6bb06ee7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:56.373715 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67037da-15bb-4860-b3e1-10b6bb06ee7e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:56.374194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67037da-15bb-4860-b3e1-10b6bb06ee7e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:56.374690 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67037da-15bb-4860-b3e1-10b6bb06ee7e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:56.385275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67037da-15bb-4860-b3e1-10b6bb06ee7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-e67037da-15bb-4860-b3e1-10b6bb06ee7e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:53:56.394425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:56.395344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:53:56.396169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:56.398895 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 463/915] 10.222.0.58 () {56 vars in 1120 bytes} [Tue May 17 11:53:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:56.406837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40557db-801d-4275-8e1a-856784fd280f None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:56.505452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40557db-801d-4275-8e1a-856784fd280f None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:56.540513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca350a-f13f-4640-9357-3287dbc42211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:56.541417 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca350a-f13f-4640-9357-3287dbc42211 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:56.541839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca350a-f13f-4640-9357-3287dbc42211 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:56.542254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca350a-f13f-4640-9357-3287dbc42211 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:56.543165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca350a-f13f-4640-9357-3287dbc42211 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:56.543628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca350a-f13f-4640-9357-3287dbc42211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:56.545158 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca350a-f13f-4640-9357-3287dbc42211 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:56.558549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 453/916] 10.222.0.58 () {56 vars in 1115 bytes} [Tue May 17 11:53:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:56.560067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67037da-15bb-4860-b3e1-10b6bb06ee7e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:56.659262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67037da-15bb-4860-b3e1-10b6bb06ee7e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:56.698859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4cd4-92cc-4ac2-8258-05286216696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:56.698859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4cd4-92cc-4ac2-8258-05286216696f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:56.698859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4cd4-92cc-4ac2-8258-05286216696f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:56.698859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4cd4-92cc-4ac2-8258-05286216696f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:56.705950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef4cd4-92cc-4ac2-8258-05286216696f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:56.707484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef4cd4-92cc-4ac2-8258-05286216696f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-3cef4cd4-92cc-4ac2-8258-05286216696f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:56.724626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:56.725515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:56.726853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:56.726853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:56.726853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:56.726853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:56.726853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 464/917] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:56.733130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca350a-f13f-4640-9357-3287dbc42211 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:56.837967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca350a-f13f-4640-9357-3287dbc42211 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:56.873935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879d817-2faa-4dc3-978e-15fb0812efcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:56.874701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d817-2faa-4dc3-978e-15fb0812efcd None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:56.874986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d817-2faa-4dc3-978e-15fb0812efcd None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:56.875274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d817-2faa-4dc3-978e-15fb0812efcd None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:56.875981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879d817-2faa-4dc3-978e-15fb0812efcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:56.876313 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879d817-2faa-4dc3-978e-15fb0812efcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:56.877809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879d817-2faa-4dc3-978e-15fb0812efcd None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:56.890339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 454/918] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:56.896065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4cd4-92cc-4ac2-8258-05286216696f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:56.997921 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4cd4-92cc-4ac2-8258-05286216696f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:57.031524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd44f-4438-40f5-81ae-fbc40bc9d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:57.032736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd44f-4438-40f5-81ae-fbc40bc9d00b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.033236 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd44f-4438-40f5-81ae-fbc40bc9d00b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.033704 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd44f-4438-40f5-81ae-fbc40bc9d00b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.041544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090dd44f-4438-40f5-81ae-fbc40bc9d00b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:57.043214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090dd44f-4438-40f5-81ae-fbc40bc9d00b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-090dd44f-4438-40f5-81ae-fbc40bc9d00b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:53:57.058879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:57.059938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:57.061359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:57.061359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:57.061359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:53:57.061359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:53:57.061359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:53:57.061359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:53:57.061359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:53:57.061359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:53:57.061359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:53:57.061359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:57.068332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 465/919] 10.222.0.58 () {56 vars in 1117 bytes} [Tue May 17 11:53:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:57.070754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879d817-2faa-4dc3-978e-15fb0812efcd None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:57.173227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879d817-2faa-4dc3-978e-15fb0812efcd None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:57.208336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff230dc6-0feb-4698-8532-dfe524b44b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:57.209012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230dc6-0feb-4698-8532-dfe524b44b2b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.209291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230dc6-0feb-4698-8532-dfe524b44b2b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.209565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230dc6-0feb-4698-8532-dfe524b44b2b None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.210408 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff230dc6-0feb-4698-8532-dfe524b44b2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:57.210715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff230dc6-0feb-4698-8532-dfe524b44b2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:57.212140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff230dc6-0feb-4698-8532-dfe524b44b2b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:57.229977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 455/920] 10.222.0.58 () {56 vars in 1149 bytes} [Tue May 17 11:53:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:57.236111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd44f-4438-40f5-81ae-fbc40bc9d00b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:57.261892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4886402-2451-472f-a4d9-d0cf941cbb84 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.262167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4886402-2451-472f-a4d9-d0cf941cbb84 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.262377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4886402-2451-472f-a4d9-d0cf941cbb84 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.263976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 456/921] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:53:57.269271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4f385-b1b6-40a8-bae0-1fa09c240168 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.269556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4f385-b1b6-40a8-bae0-1fa09c240168 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.269825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4f385-b1b6-40a8-bae0-1fa09c240168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.288021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-33d4f385-b1b6-40a8-bae0-1fa09c240168 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:57.289441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-33d4f385-b1b6-40a8-bae0-1fa09c240168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:57.354027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd44f-4438-40f5-81ae-fbc40bc9d00b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:57.356439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 457/922] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:53:57.379955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4f385-b1b6-40a8-bae0-1fa09c240168 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:57.391469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a67ee-85e1-4fb6-a4f1-ce22d6ffb699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:57.392628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a67ee-85e1-4fb6-a4f1-ce22d6ffb699 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.392920 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a67ee-85e1-4fb6-a4f1-ce22d6ffb699 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.393361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a67ee-85e1-4fb6-a4f1-ce22d6ffb699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.409880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a67ee-85e1-4fb6-a4f1-ce22d6ffb699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:57.411408 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a67ee-85e1-4fb6-a4f1-ce22d6ffb699 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-b30a67ee-85e1-4fb6-a4f1-ce22d6ffb699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:53:57.428935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:57.429871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:57.430760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:53:57.430760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:53:57.430760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:53:57.430760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:57.430760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 466/923] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:57.437747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a67ee-85e1-4fb6-a4f1-ce22d6ffb699 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:57.505472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4f385-b1b6-40a8-bae0-1fa09c240168 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:57.551146 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068e205-de3b-4835-862b-4e5c702726b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:57.552108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068e205-de3b-4835-862b-4e5c702726b3 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.552430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068e205-de3b-4835-862b-4e5c702726b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.552710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068e205-de3b-4835-862b-4e5c702726b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.553371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068e205-de3b-4835-862b-4e5c702726b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:57.555267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068e205-de3b-4835-862b-4e5c702726b3 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:57.565595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a67ee-85e1-4fb6-a4f1-ce22d6ffb699 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-6068e205-de3b-4835-862b-4e5c702726b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:57.569490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:57.570676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 11:53:57.571580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:53:57.574429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 458/924] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:57.580824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068e205-de3b-4835-862b-4e5c702726b3 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:57.610621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed0734-3336-4f06-8f47-5509a86d36fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:57.611270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0734-3336-4f06-8f47-5509a86d36fb None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.611555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0734-3336-4f06-8f47-5509a86d36fb None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.611823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0734-3336-4f06-8f47-5509a86d36fb None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.612574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed0734-3336-4f06-8f47-5509a86d36fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:57.612875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed0734-3336-4f06-8f47-5509a86d36fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:57.614243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed0734-3336-4f06-8f47-5509a86d36fb None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:57.626688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 467/925] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:57.627857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a25c-877a-45f8-8dc3-6995fe269a5c None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.628142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a25c-877a-45f8-8dc3-6995fe269a5c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.628445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52a25c-877a-45f8-8dc3-6995fe269a5c None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.629904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 468/926] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:57.632194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52a25c-877a-45f8-8dc3-6995fe269a5c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:57.694482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068e205-de3b-4835-862b-4e5c702726b3 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:57.727847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a28ad-2807-4ddb-b1cf-d3fa22bc7588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:57.728542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a28ad-2807-4ddb-b1cf-d3fa22bc7588 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.728822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a28ad-2807-4ddb-b1cf-d3fa22bc7588 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.729100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a28ad-2807-4ddb-b1cf-d3fa22bc7588 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.729801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a28ad-2807-4ddb-b1cf-d3fa22bc7588 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:57.730108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a28ad-2807-4ddb-b1cf-d3fa22bc7588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:57.731466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a28ad-2807-4ddb-b1cf-d3fa22bc7588 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:57.735594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52a25c-877a-45f8-8dc3-6995fe269a5c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:57.741242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 459/927] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:53:57.741242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d0736-a2db-465b-adb3-e453b00daad1 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.741242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d0736-a2db-465b-adb3-e453b00daad1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.741242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d0736-a2db-465b-adb3-e453b00daad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.753965 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-506d0736-a2db-465b-adb3-e453b00daad1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:57.755121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-506d0736-a2db-465b-adb3-e453b00daad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:57.774332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44117644-f8d2-4c19-887f-c0279b7a5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:57.775173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44117644-f8d2-4c19-887f-c0279b7a5de7 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.775453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44117644-f8d2-4c19-887f-c0279b7a5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.775726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44117644-f8d2-4c19-887f-c0279b7a5de7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.783067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44117644-f8d2-4c19-887f-c0279b7a5de7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:57.784470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44117644-f8d2-4c19-887f-c0279b7a5de7 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-44117644-f8d2-4c19-887f-c0279b7a5de7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:53:57.798461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:57.799398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:57.800735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:53:57.800735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:53:57.800735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:53:57.800735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:53:57.800735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:53:57.800735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:53:57.800735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:53:57.800735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:57.800735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 469/928] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:53:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:57.800735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44117644-f8d2-4c19-887f-c0279b7a5de7 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:57.828226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 460/929] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:57.828226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d0736-a2db-465b-adb3-e453b00daad1 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:57.907657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44117644-f8d2-4c19-887f-c0279b7a5de7 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:57.939424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d0736-a2db-465b-adb3-e453b00daad1 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:57.941964 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e4f3c-383e-48aa-b3cd-a4384d66e42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:57.942643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4f3c-383e-48aa-b3cd-a4384d66e42f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.942922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4f3c-383e-48aa-b3cd-a4384d66e42f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.943195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e4f3c-383e-48aa-b3cd-a4384d66e42f None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.943916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e4f3c-383e-48aa-b3cd-a4384d66e42f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:57.944253 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e4f3c-383e-48aa-b3cd-a4384d66e42f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:57.945623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e4f3c-383e-48aa-b3cd-a4384d66e42f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:57.951193 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 470/930] 10.222.0.58 () {56 vars in 1114 bytes} [Tue May 17 11:53:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:57.952278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e4f3c-383e-48aa-b3cd-a4384d66e42f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:57.978649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0032fc1-58dc-4f1c-9d0a-32af88d135bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:57.979317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0032fc1-58dc-4f1c-9d0a-32af88d135bd None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:57.979595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0032fc1-58dc-4f1c-9d0a-32af88d135bd None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:57.979872 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0032fc1-58dc-4f1c-9d0a-32af88d135bd None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:57.980679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0032fc1-58dc-4f1c-9d0a-32af88d135bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:57.980985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0032fc1-58dc-4f1c-9d0a-32af88d135bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:57.982402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0032fc1-58dc-4f1c-9d0a-32af88d135bd None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:57.995643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 461/931] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:53:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:57.996821 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0032fc1-58dc-4f1c-9d0a-32af88d135bd None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:58.053087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e4f3c-383e-48aa-b3cd-a4384d66e42f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:58.083973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a238be-4c27-4d44-ba3f-8ab45f28c45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:58.084863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a238be-4c27-4d44-ba3f-8ab45f28c45b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:58.085141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a238be-4c27-4d44-ba3f-8ab45f28c45b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:58.085417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a238be-4c27-4d44-ba3f-8ab45f28c45b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:58.086055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a238be-4c27-4d44-ba3f-8ab45f28c45b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:58.087414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a238be-4c27-4d44-ba3f-8ab45f28c45b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:58.091491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0032fc1-58dc-4f1c-9d0a-32af88d135bd None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-18a238be-4c27-4d44-ba3f-8ab45f28c45b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:58.099749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:58.100674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:58.101526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 471/932] 10.222.0.58 () {56 vars in 1132 bytes} [Tue May 17 11:53:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:53:58.102440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a238be-4c27-4d44-ba3f-8ab45f28c45b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:58.128801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0a9f9-f1b8-4c71-ab3e-2f1db6ab4dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:58.129456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0a9f9-f1b8-4c71-ab3e-2f1db6ab4dd9 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:58.129735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0a9f9-f1b8-4c71-ab3e-2f1db6ab4dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:58.130013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0a9f9-f1b8-4c71-ab3e-2f1db6ab4dd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:58.130741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0a9f9-f1b8-4c71-ab3e-2f1db6ab4dd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:58.132095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0a9f9-f1b8-4c71-ab3e-2f1db6ab4dd9 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:58.150863 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 462/933] 10.222.0.58 () {60 vars in 1144 bytes} [Tue May 17 11:53:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:53:58.152239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f924ed-49d3-4518-8a7b-90ada56f1e04 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:58.152527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f924ed-49d3-4518-8a7b-90ada56f1e04 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:58.152796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f924ed-49d3-4518-8a7b-90ada56f1e04 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:58.154195 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 463/934] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:53:58.155351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f924ed-49d3-4518-8a7b-90ada56f1e04 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:58.208124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a238be-4c27-4d44-ba3f-8ab45f28c45b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:58.250706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67bf95-a27a-4b6f-8326-dba1d8658507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:58.251926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67bf95-a27a-4b6f-8326-dba1d8658507 None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:58.252229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67bf95-a27a-4b6f-8326-dba1d8658507 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:58.252506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67bf95-a27a-4b6f-8326-dba1d8658507 None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/1fbb465d777c4f02b7777ad154d09c8c/roles/06c32961ffa44ca7ab91a257468ae7d4` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:58.254797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67bf95-a27a-4b6f-8326-dba1d8658507 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=1fbb465d777c4f02b7777ad154d09c8c, role_id=06c32961ffa44ca7ab91a257468ae7d4)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:58.256338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67bf95-a27a-4b6f-8326-dba1d8658507 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:58.280217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 472/935] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:53:58 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/1fbb465d777c4f02b7777ad154d09c8c/roles/06c32961ffa44ca7ab91a257468ae7d4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:53:58.280217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca700bb-8dcd-4751-a8e2-56b50e3cad84 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:58.280217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca700bb-8dcd-4751-a8e2-56b50e3cad84 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:58.280217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca700bb-8dcd-4751-a8e2-56b50e3cad84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:58.281729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f924ed-49d3-4518-8a7b-90ada56f1e04 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:58.301230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-4ca700bb-8dcd-4751-a8e2-56b50e3cad84 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:53:58.302759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4ca700bb-8dcd-4751-a8e2-56b50e3cad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:53:58.328994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe6ac-05ad-4490-a266-23749b580ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:58.329782 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe6ac-05ad-4490-a266-23749b580ad3 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:58.330324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe6ac-05ad-4490-a266-23749b580ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:58.330674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbe6ac-05ad-4490-a266-23749b580ad3 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:58.331998 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe6ac-05ad-4490-a266-23749b580ad3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:58.332404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe6ac-05ad-4490-a266-23749b580ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:58.334504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbe6ac-05ad-4490-a266-23749b580ad3 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:58.344376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 464/936] 10.222.0.58 () {56 vars in 1126 bytes} [Tue May 17 11:53:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:58.348345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe6ac-05ad-4490-a266-23749b580ad3 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:58.388265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 473/937] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:53:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:53:58.413067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca700bb-8dcd-4751-a8e2-56b50e3cad84 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:58.472388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbe6ac-05ad-4490-a266-23749b580ad3 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:58.508970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4172209-0d3f-47cf-a2f3-0b382dfc758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:58.509700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4172209-0d3f-47cf-a2f3-0b382dfc758e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:58.510052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4172209-0d3f-47cf-a2f3-0b382dfc758e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:58.510340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4172209-0d3f-47cf-a2f3-0b382dfc758e None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:58.511434 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4172209-0d3f-47cf-a2f3-0b382dfc758e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:58.512041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4172209-0d3f-47cf-a2f3-0b382dfc758e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:58.513869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4172209-0d3f-47cf-a2f3-0b382dfc758e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:58.521139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 465/938] 10.222.0.58 () {56 vars in 1126 bytes} [Tue May 17 11:53:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:58.527127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4172209-0d3f-47cf-a2f3-0b382dfc758e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:58.542989 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca700bb-8dcd-4751-a8e2-56b50e3cad84 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:58.578400 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555bbf2-8a8e-441b-8c1f-a87a4accdbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:58.579947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555bbf2-8a8e-441b-8c1f-a87a4accdbb8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:58.580403 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555bbf2-8a8e-441b-8c1f-a87a4accdbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:58.580832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555bbf2-8a8e-441b-8c1f-a87a4accdbb8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:58.581637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555bbf2-8a8e-441b-8c1f-a87a4accdbb8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:58.583149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555bbf2-8a8e-441b-8c1f-a87a4accdbb8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-c555bbf2-8a8e-441b-8c1f-a87a4accdbb8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:53:58.595710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:53:58.596940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:53:58.597942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:53:58.600482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 474/939] 10.222.0.58 () {56 vars in 1126 bytes} [Tue May 17 11:53:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:53:58.606812 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555bbf2-8a8e-441b-8c1f-a87a4accdbb8 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:58.647105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4172209-0d3f-47cf-a2f3-0b382dfc758e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:58.683884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93ea4f-4af3-4ee2-b9dd-4473f16c0494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:58.684570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93ea4f-4af3-4ee2-b9dd-4473f16c0494 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:58.684850 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93ea4f-4af3-4ee2-b9dd-4473f16c0494 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:58.685125 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93ea4f-4af3-4ee2-b9dd-4473f16c0494 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:58.686197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93ea4f-4af3-4ee2-b9dd-4473f16c0494 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:58.687662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93ea4f-4af3-4ee2-b9dd-4473f16c0494 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:58.709268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 466/940] 10.222.0.58 () {60 vars in 1144 bytes} [Tue May 17 11:53:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:53:58.731727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555bbf2-8a8e-441b-8c1f-a87a4accdbb8 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:58.776511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dbb6c-0b77-4714-8cd9-28e22a2c9ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:58.777481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dbb6c-0b77-4714-8cd9-28e22a2c9ae6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:58.777909 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dbb6c-0b77-4714-8cd9-28e22a2c9ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:58.778327 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dbb6c-0b77-4714-8cd9-28e22a2c9ae6 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:58.779221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dbb6c-0b77-4714-8cd9-28e22a2c9ae6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:58.780311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dbb6c-0b77-4714-8cd9-28e22a2c9ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:58.782396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dbb6c-0b77-4714-8cd9-28e22a2c9ae6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:58.788845 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 475/941] 10.222.0.58 () {56 vars in 1122 bytes} [Tue May 17 11:53:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:58.794980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93ea4f-4af3-4ee2-b9dd-4473f16c0494 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:58.905343 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93ea4f-4af3-4ee2-b9dd-4473f16c0494 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:58.938723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddd114-f610-4329-9dc7-5fe4fec598bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:58.939392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd114-f610-4329-9dc7-5fe4fec598bb None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:58.939732 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd114-f610-4329-9dc7-5fe4fec598bb None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:58.940012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddd114-f610-4329-9dc7-5fe4fec598bb None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:58.940785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddd114-f610-4329-9dc7-5fe4fec598bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:58.941078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddd114-f610-4329-9dc7-5fe4fec598bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:58.942440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddd114-f610-4329-9dc7-5fe4fec598bb None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:58.947699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 467/942] 10.222.0.58 () {56 vars in 1122 bytes} [Tue May 17 11:53:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:58.953702 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dbb6c-0b77-4714-8cd9-28e22a2c9ae6 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:59.054740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dbb6c-0b77-4714-8cd9-28e22a2c9ae6 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:59.089343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3e52c-0a71-46b8-b5ca-22e4064967d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:59.090274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3e52c-0a71-46b8-b5ca-22e4064967d4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:59.090698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3e52c-0a71-46b8-b5ca-22e4064967d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:59.091111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3e52c-0a71-46b8-b5ca-22e4064967d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:59.092030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3e52c-0a71-46b8-b5ca-22e4064967d4 None admin] RBAC: Adding query filter params (interface=public, service_id=3bc643012e214a6cb1e855c76e79837f, region_id=RegionOne) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:53:59.092673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3e52c-0a71-46b8-b5ca-22e4064967d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:59.094281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3e52c-0a71-46b8-b5ca-22e4064967d4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:59.099885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 476/943] 10.222.0.58 () {56 vars in 1251 bytes} [Tue May 17 11:53:58 2022] GET /identity/v3/endpoints?service_id=3bc643012e214a6cb1e855c76e79837f&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:53:59.105696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddd114-f610-4329-9dc7-5fe4fec598bb None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:53:59.213379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddd114-f610-4329-9dc7-5fe4fec598bb None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:53:59.247253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f0568-7aa8-4132-b136-c115fb9d9072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:53:59.247918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f0568-7aa8-4132-b136-c115fb9d9072 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:53:59.248210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f0568-7aa8-4132-b136-c115fb9d9072 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:53:59.249265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f0568-7aa8-4132-b136-c115fb9d9072 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:53:59.249945 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f0568-7aa8-4132-b136-c115fb9d9072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:53:59.251313 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f0568-7aa8-4132-b136-c115fb9d9072 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:53:59.257627 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 468/944] 10.222.0.58 () {56 vars in 1087 bytes} [Tue May 17 11:53:59 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 11:54:00.561318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8b354-d229-47e1-9f42-01ef7b0eb42e None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:00.561843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8b354-d229-47e1-9f42-01ef7b0eb42e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:00.562226 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8b354-d229-47e1-9f42-01ef7b0eb42e None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:00.563999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 477/945] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:00.569720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebf534-1a17-43fe-a2e4-5bf00ec04731 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:00.570172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebf534-1a17-43fe-a2e4-5bf00ec04731 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:00.570253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebf534-1a17-43fe-a2e4-5bf00ec04731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:00.587694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ebebf534-1a17-43fe-a2e4-5bf00ec04731 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:00.588902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ebebf534-1a17-43fe-a2e4-5bf00ec04731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:00.657910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 469/946] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:54:00.680583 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8b354-d229-47e1-9f42-01ef7b0eb42e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:00.723282 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9773-5847-48cf-b721-8217ad14ca1d None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:00.723613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9773-5847-48cf-b721-8217ad14ca1d None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:00.723836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf9773-5847-48cf-b721-8217ad14ca1d None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:00.725483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 470/947] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:54:00.732412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23da9e-a9a0-496c-bcc1-c756829e7a2b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:00.733353 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23da9e-a9a0-496c-bcc1-c756829e7a2b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:00.733731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23da9e-a9a0-496c-bcc1-c756829e7a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:00.751360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-5f23da9e-a9a0-496c-bcc1-c756829e7a2b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:00.752849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5f23da9e-a9a0-496c-bcc1-c756829e7a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:00.788470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8b354-d229-47e1-9f42-01ef7b0eb42e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:00.822026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 471/948] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:54:00.826451 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddad7a-9d93-49e1-bc04-0e9295eed104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:00.827235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddad7a-9d93-49e1-bc04-0e9295eed104 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:00.827515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddad7a-9d93-49e1-bc04-0e9295eed104 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:00.827786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddad7a-9d93-49e1-bc04-0e9295eed104 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:00.828526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddad7a-9d93-49e1-bc04-0e9295eed104 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:00.829960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddad7a-9d93-49e1-bc04-0e9295eed104 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:00.831312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: WARNING keystone.server.flask.common [None req-fbddad7a-9d93-49e1-bc04-0e9295eed104 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 17 11:54:00.843961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23da9e-a9a0-496c-bcc1-c756829e7a2b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:00.857362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.sql.core [None req-fbddad7a-9d93-49e1-bc04-0e9295eed104 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 11:54:00.857362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 11:54:00.857362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [parameters: {'id': '6933807a0bab40b1b5fdddee9a468e2c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 11:54:00.857362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79870) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-fbddad7a-9d93-49e1-bc04-0e9295eed104 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6933807a0bab40b1b5fdddee9a468e2c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6933807a0bab40b1b5fdddee9a468e2c. May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application result = self._query(query) May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application conn.query(q) May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 11:54:00.879113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application result.read() May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 17 11:54:00.880013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return project_ref.to_dict() May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application next(self.gen) May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application yield resource May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application next(self.gen) May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self.session.rollback() May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self.force_reraise() May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise self.value May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application session.commit() May 17 11:54:00.880987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._prepare_impl() May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self.session.flush() May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._flush(objects) May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application compat.raise_( May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application flush_context.execute() May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 11:54:00.881882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rec.execute(self) May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 11:54:00.882765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application result = self._query(query) May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application conn.query(q) May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application result.read() May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 11:54:00.883533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [parameters: {'id': '6933807a0bab40b1b5fdddee9a468e2c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:00.884477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:00.885247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:00.886142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:00.886142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 17 11:54:00.886142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 17 11:54:00.886142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:00.886142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:00.886142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 17 11:54:00.886142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.Conflict( May 17 11:54:00.886142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6933807a0bab40b1b5fdddee9a468e2c. May 17 11:54:00.886142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:00.886142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 478/949] 10.222.0.58 () {60 vars in 1140 bytes} [Tue May 17 11:54:00 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:00.891083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddad7a-9d93-49e1-bc04-0e9295eed104 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:00.958123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23da9e-a9a0-496c-bcc1-c756829e7a2b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:00.992525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be172709-f822-43a3-b1f3-2a79eaa518ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:00.993334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be172709-f822-43a3-b1f3-2a79eaa518ac None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:00.993616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be172709-f822-43a3-b1f3-2a79eaa518ac None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:00.993888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be172709-f822-43a3-b1f3-2a79eaa518ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:00.997478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddad7a-9d93-49e1-bc04-0e9295eed104 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:01.004784 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be172709-f822-43a3-b1f3-2a79eaa518ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-be172709-f822-43a3-b1f3-2a79eaa518ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:54:01.012893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:01.013788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:54:01.014640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:01.019072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 472/950] 10.222.0.58 () {56 vars in 1120 bytes} [Tue May 17 11:54:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:54:01.020426 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be172709-f822-43a3-b1f3-2a79eaa518ac None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:01.037157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bde56c-7efd-44d6-b265-42673ff45780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:01.038336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bde56c-7efd-44d6-b265-42673ff45780 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.038870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bde56c-7efd-44d6-b265-42673ff45780 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.039319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bde56c-7efd-44d6-b265-42673ff45780 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.047859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bde56c-7efd-44d6-b265-42673ff45780 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:01.049942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bde56c-7efd-44d6-b265-42673ff45780 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-40bde56c-7efd-44d6-b265-42673ff45780 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:54:01.066528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:01.067466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:01.068345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:54:01.068345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:54:01.068345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:54:01.068345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:54:01.068345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:54:01.068345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:54:01.068345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:54:01.068345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:01.070597 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 479/951] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:01.076647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bde56c-7efd-44d6-b265-42673ff45780 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:01.144992 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be172709-f822-43a3-b1f3-2a79eaa518ac None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:01.179448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f712c-8b79-4d2e-bd9f-1c5f36c183ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:01.180415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f712c-8b79-4d2e-bd9f-1c5f36c183ce None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.180838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f712c-8b79-4d2e-bd9f-1c5f36c183ce None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.181255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f712c-8b79-4d2e-bd9f-1c5f36c183ce None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.182139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f712c-8b79-4d2e-bd9f-1c5f36c183ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:01.182586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f712c-8b79-4d2e-bd9f-1c5f36c183ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:01.184172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f712c-8b79-4d2e-bd9f-1c5f36c183ce None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:01.193700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 473/952] 10.222.0.58 () {56 vars in 1115 bytes} [Tue May 17 11:54:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:01.199823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f712c-8b79-4d2e-bd9f-1c5f36c183ce None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:01.204847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bde56c-7efd-44d6-b265-42673ff45780 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:01.240737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5d595-235b-48e7-8d7d-a1816b1a93e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:01.241584 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d595-235b-48e7-8d7d-a1816b1a93e5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.241968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d595-235b-48e7-8d7d-a1816b1a93e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.242343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d595-235b-48e7-8d7d-a1816b1a93e5 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.243200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d595-235b-48e7-8d7d-a1816b1a93e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:01.243609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d595-235b-48e7-8d7d-a1816b1a93e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:01.245166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d595-235b-48e7-8d7d-a1816b1a93e5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:01.266661 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 480/953] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:54:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:01.268164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe7bc-48e2-47d1-b60d-93c630790766 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.268573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe7bc-48e2-47d1-b60d-93c630790766 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.268989 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe7bc-48e2-47d1-b60d-93c630790766 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.270558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 481/954] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:01.276227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6214bc5-1854-4a10-9af9-dd8f83e4733f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.276520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6214bc5-1854-4a10-9af9-dd8f83e4733f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.276800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6214bc5-1854-4a10-9af9-dd8f83e4733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.298179 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-e6214bc5-1854-4a10-9af9-dd8f83e4733f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:01.300047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e6214bc5-1854-4a10-9af9-dd8f83e4733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:01.323947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f712c-8b79-4d2e-bd9f-1c5f36c183ce None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:01.369413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac39e9-9a51-4ded-ab4b-fb1d05b5cc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:01.370792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac39e9-9a51-4ded-ab4b-fb1d05b5cc0c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.371338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac39e9-9a51-4ded-ab4b-fb1d05b5cc0c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.371792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac39e9-9a51-4ded-ab4b-fb1d05b5cc0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.376760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 482/955] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:54:01.388586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac39e9-9a51-4ded-ab4b-fb1d05b5cc0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:01.391217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac39e9-9a51-4ded-ab4b-fb1d05b5cc0c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:01.400145 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6214bc5-1854-4a10-9af9-dd8f83e4733f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-e5ac39e9-9a51-4ded-ab4b-fb1d05b5cc0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:54:01.425041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:01.426007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:01.426893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:54:01.426893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:54:01.426893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:01.426893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:01.429755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 474/956] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:54:01.436835 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac39e9-9a51-4ded-ab4b-fb1d05b5cc0c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:01.542058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6214bc5-1854-4a10-9af9-dd8f83e4733f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:01.582660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebfa64-e4c7-4496-91a8-f3b5fa5a3e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:01.583368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebfa64-e4c7-4496-91a8-f3b5fa5a3e51 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.584215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebfa64-e4c7-4496-91a8-f3b5fa5a3e51 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.584215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebfa64-e4c7-4496-91a8-f3b5fa5a3e51 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.584604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebfa64-e4c7-4496-91a8-f3b5fa5a3e51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:01.585979 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebfa64-e4c7-4496-91a8-f3b5fa5a3e51 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:01.591001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac39e9-9a51-4ded-ab4b-fb1d05b5cc0c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-2bebfa64-e4c7-4496-91a8-f3b5fa5a3e51 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:01.602443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:01.603537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 11:54:01.604697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:01.609960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 483/957] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:54:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:54:01.611267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebfa64-e4c7-4496-91a8-f3b5fa5a3e51 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:01.629487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a371c4-62b4-41e3-83f3-5cae7a901159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:01.630153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a371c4-62b4-41e3-83f3-5cae7a901159 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.630435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a371c4-62b4-41e3-83f3-5cae7a901159 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.630718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a371c4-62b4-41e3-83f3-5cae7a901159 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.631420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a371c4-62b4-41e3-83f3-5cae7a901159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:01.631727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a371c4-62b4-41e3-83f3-5cae7a901159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:01.633117 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a371c4-62b4-41e3-83f3-5cae7a901159 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:01.649733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 475/958] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:01.649733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b11f6-aa58-451c-9279-10568fa9fe92 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.649733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b11f6-aa58-451c-9279-10568fa9fe92 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.649733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b11f6-aa58-451c-9279-10568fa9fe92 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.650354 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 476/959] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:01.651334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b11f6-aa58-451c-9279-10568fa9fe92 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:01.710913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebfa64-e4c7-4496-91a8-f3b5fa5a3e51 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:01.744454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8bc29-6b9e-4151-8d4d-b0a114cc15e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:01.745291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8bc29-6b9e-4151-8d4d-b0a114cc15e9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.745749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8bc29-6b9e-4151-8d4d-b0a114cc15e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.746038 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8bc29-6b9e-4151-8d4d-b0a114cc15e9 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.746764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8bc29-6b9e-4151-8d4d-b0a114cc15e9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:01.747076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8bc29-6b9e-4151-8d4d-b0a114cc15e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:01.749078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8bc29-6b9e-4151-8d4d-b0a114cc15e9 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:01.752626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b11f6-aa58-451c-9279-10568fa9fe92 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:01.753936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 484/960] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:54:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:01.758503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22b810-9fbd-49c4-9dbd-a550ff16ff8d None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.758503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22b810-9fbd-49c4-9dbd-a550ff16ff8d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.758503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22b810-9fbd-49c4-9dbd-a550ff16ff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.772765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-9a22b810-9fbd-49c4-9dbd-a550ff16ff8d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:01.774162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9a22b810-9fbd-49c4-9dbd-a550ff16ff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:01.794315 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db6e5f-f341-4126-92c8-5a434f72b203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:01.795119 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6e5f-f341-4126-92c8-5a434f72b203 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.796123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6e5f-f341-4126-92c8-5a434f72b203 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.796632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6e5f-f341-4126-92c8-5a434f72b203 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.803749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db6e5f-f341-4126-92c8-5a434f72b203 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:01.805209 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db6e5f-f341-4126-92c8-5a434f72b203 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-04db6e5f-f341-4126-92c8-5a434f72b203 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:54:01.820638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:01.821626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:01.822545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:01.822545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:01.822545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:54:01.822545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:54:01.822545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:54:01.822545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:54:01.822545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:54:01.822545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:54:01.822545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 11:54:01.822545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:01.822545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 477/961] 10.222.0.58 () {56 vars in 1117 bytes} [Tue May 17 11:54:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:01.823500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db6e5f-f341-4126-92c8-5a434f72b203 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:01.846907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 485/962] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:01.847677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22b810-9fbd-49c4-9dbd-a550ff16ff8d None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:01.926760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db6e5f-f341-4126-92c8-5a434f72b203 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:01.954327 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22b810-9fbd-49c4-9dbd-a550ff16ff8d None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:01.960449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c552a-903b-496f-b2b7-f42d83468398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:01.961115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c552a-903b-496f-b2b7-f42d83468398 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:01.961397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c552a-903b-496f-b2b7-f42d83468398 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:01.961674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c552a-903b-496f-b2b7-f42d83468398 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:01.962380 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c552a-903b-496f-b2b7-f42d83468398 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:01.962686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c552a-903b-496f-b2b7-f42d83468398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:01.964058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c552a-903b-496f-b2b7-f42d83468398 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:01.969629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 478/963] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:54:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:01.977790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c552a-903b-496f-b2b7-f42d83468398 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:02.000645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769ac72-f8c4-43f8-abe8-52d3cdc19047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:02.001745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ac72-f8c4-43f8-abe8-52d3cdc19047 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:02.002235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ac72-f8c4-43f8-abe8-52d3cdc19047 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:02.002712 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ac72-f8c4-43f8-abe8-52d3cdc19047 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:02.004469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769ac72-f8c4-43f8-abe8-52d3cdc19047 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:02.005322 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769ac72-f8c4-43f8-abe8-52d3cdc19047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:02.007645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769ac72-f8c4-43f8-abe8-52d3cdc19047 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:02.033623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 486/964] 10.222.0.58 () {56 vars in 1149 bytes} [Tue May 17 11:54:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:02.039070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769ac72-f8c4-43f8-abe8-52d3cdc19047 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:02.089955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c552a-903b-496f-b2b7-f42d83468398 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:02.128458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f078d-5d04-491a-958a-c5ee7f5523db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:02.129360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f078d-5d04-491a-958a-c5ee7f5523db None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:02.129895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f078d-5d04-491a-958a-c5ee7f5523db None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:02.130284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f078d-5d04-491a-958a-c5ee7f5523db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:02.131166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f078d-5d04-491a-958a-c5ee7f5523db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:02.132760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f078d-5d04-491a-958a-c5ee7f5523db None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-b20f078d-5d04-491a-958a-c5ee7f5523db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:02.146040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:02.147338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:54:02.148219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:02.155129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 479/965] 10.222.0.58 () {56 vars in 1126 bytes} [Tue May 17 11:54:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:02.156386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f078d-5d04-491a-958a-c5ee7f5523db None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:02.171142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769ac72-f8c4-43f8-abe8-52d3cdc19047 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:02.212650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1808f8a-af00-4eed-aef1-71ad90a2a421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:02.213471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1808f8a-af00-4eed-aef1-71ad90a2a421 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:02.213757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1808f8a-af00-4eed-aef1-71ad90a2a421 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:02.214427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1808f8a-af00-4eed-aef1-71ad90a2a421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:02.267324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f078d-5d04-491a-958a-c5ee7f5523db None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:02.301787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c12ae-e817-406b-9bf0-439b29e3450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:02.302458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c12ae-e817-406b-9bf0-439b29e3450d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:02.302742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c12ae-e817-406b-9bf0-439b29e3450d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:02.303020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c12ae-e817-406b-9bf0-439b29e3450d None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:02.303195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1808f8a-af00-4eed-aef1-71ad90a2a421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:02.303726 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c12ae-e817-406b-9bf0-439b29e3450d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:02.304034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c12ae-e817-406b-9bf0-439b29e3450d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:02.304670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1808f8a-af00-4eed-aef1-71ad90a2a421 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:02.305426 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c12ae-e817-406b-9bf0-439b29e3450d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:02.310516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 480/966] 10.222.0.58 () {56 vars in 1122 bytes} [Tue May 17 11:54:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:02.317753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c12ae-e817-406b-9bf0-439b29e3450d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:02.419544 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c12ae-e817-406b-9bf0-439b29e3450d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:02.434985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 487/967] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:54:02 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:54:02.441180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1808f8a-af00-4eed-aef1-71ad90a2a421 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:02.460494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652fe41-8e15-4021-bc16-3eea1494046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:02.461608 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652fe41-8e15-4021-bc16-3eea1494046f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:02.462570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652fe41-8e15-4021-bc16-3eea1494046f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:02.463054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652fe41-8e15-4021-bc16-3eea1494046f None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:02.464230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652fe41-8e15-4021-bc16-3eea1494046f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:02.464859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652fe41-8e15-4021-bc16-3eea1494046f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:02.467083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652fe41-8e15-4021-bc16-3eea1494046f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:02.474380 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 481/968] 10.222.0.58 () {56 vars in 1122 bytes} [Tue May 17 11:54:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:02.479634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652fe41-8e15-4021-bc16-3eea1494046f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:02.559021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1808f8a-af00-4eed-aef1-71ad90a2a421 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:02.597410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1c63-968a-4b8e-a48c-6f5efb33a7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:02.598073 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1c63-968a-4b8e-a48c-6f5efb33a7b7 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:02.598362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1c63-968a-4b8e-a48c-6f5efb33a7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:02.598641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1c63-968a-4b8e-a48c-6f5efb33a7b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:02.607437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652fe41-8e15-4021-bc16-3eea1494046f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:02.611247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd1c63-968a-4b8e-a48c-6f5efb33a7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:02.612752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd1c63-968a-4b8e-a48c-6f5efb33a7b7 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-01dd1c63-968a-4b8e-a48c-6f5efb33a7b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:54:02.631197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:02.632111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:02.633021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:54:02.633021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:54:02.633021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:02.633021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:02.633021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 488/969] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:02.638605 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1c63-968a-4b8e-a48c-6f5efb33a7b7 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:02.650662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c26bb-5099-4b98-84b2-cb9daaab276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:02.651327 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c26bb-5099-4b98-84b2-cb9daaab276d None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:02.651609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c26bb-5099-4b98-84b2-cb9daaab276d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:02.651886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c26bb-5099-4b98-84b2-cb9daaab276d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:02.653030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c26bb-5099-4b98-84b2-cb9daaab276d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:02.655228 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c26bb-5099-4b98-84b2-cb9daaab276d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:02.684297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 482/970] 10.222.0.58 () {60 vars in 1144 bytes} [Tue May 17 11:54:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:54:02.758010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1c63-968a-4b8e-a48c-6f5efb33a7b7 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:02.802363 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88417fe4-3bb1-40e0-ba83-611ebc28d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:02.803033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417fe4-3bb1-40e0-ba83-611ebc28d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:02.803314 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417fe4-3bb1-40e0-ba83-611ebc28d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:02.803589 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417fe4-3bb1-40e0-ba83-611ebc28d5a7 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:02.804417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88417fe4-3bb1-40e0-ba83-611ebc28d5a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:02.804727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88417fe4-3bb1-40e0-ba83-611ebc28d5a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:02.806105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88417fe4-3bb1-40e0-ba83-611ebc28d5a7 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:02.819825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 489/971] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:02.825556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c26bb-5099-4b98-84b2-cb9daaab276d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:02.929487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c26bb-5099-4b98-84b2-cb9daaab276d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:02.963148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64541e-bc31-46a9-a7de-6fa255c30ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:02.963868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64541e-bc31-46a9-a7de-6fa255c30ea8 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:02.964149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64541e-bc31-46a9-a7de-6fa255c30ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:02.964450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64541e-bc31-46a9-a7de-6fa255c30ea8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:02.971529 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64541e-bc31-46a9-a7de-6fa255c30ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:02.973002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64541e-bc31-46a9-a7de-6fa255c30ea8 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-ca64541e-bc31-46a9-a7de-6fa255c30ea8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:54:02.987857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:02.988827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:02.989746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:54:02.989746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:54:02.989746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:54:02.989746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:54:02.989746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:54:02.989746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:54:02.989746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:54:02.989746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:02.989746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 483/972] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:54:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:02.995150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88417fe4-3bb1-40e0-ba83-611ebc28d5a7 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:03.095401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88417fe4-3bb1-40e0-ba83-611ebc28d5a7 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:03.131102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb27a1-1415-4daf-96bc-6d4187bd9d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:03.131846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb27a1-1415-4daf-96bc-6d4187bd9d6c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:03.132134 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb27a1-1415-4daf-96bc-6d4187bd9d6c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:03.132446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb27a1-1415-4daf-96bc-6d4187bd9d6c None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:03.133259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb27a1-1415-4daf-96bc-6d4187bd9d6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:03.133574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb27a1-1415-4daf-96bc-6d4187bd9d6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:03.135080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb27a1-1415-4daf-96bc-6d4187bd9d6c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:03.149192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 490/973] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:54:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:03.155251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64541e-bc31-46a9-a7de-6fa255c30ea8 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:03.265105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64541e-bc31-46a9-a7de-6fa255c30ea8 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:03.301029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f2f31-54c4-4506-b137-7cdc83783a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:03.301691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f2f31-54c4-4506-b137-7cdc83783a5e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:03.301972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f2f31-54c4-4506-b137-7cdc83783a5e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:03.302248 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f2f31-54c4-4506-b137-7cdc83783a5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:03.303090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f2f31-54c4-4506-b137-7cdc83783a5e None admin] RBAC: Adding query filter params (role.id=06c32961ffa44ca7ab91a257468ae7d4, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=1fbb465d777c4f02b7777ad154d09c8c) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:03.303403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f2f31-54c4-4506-b137-7cdc83783a5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:03.304875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f2f31-54c4-4506-b137-7cdc83783a5e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:03.311843 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 484/974] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:54:03 2022] GET /identity/v3/role_assignments?user.id=1fbb465d777c4f02b7777ad154d09c8c&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=06c32961ffa44ca7ab91a257468ae7d4 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:03.636769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0e94b-850c-4f72-b538-812431af5751 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:03.637449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0e94b-850c-4f72-b538-812431af5751 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:03.637449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0e94b-850c-4f72-b538-812431af5751 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:03.638874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 491/975] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:03.645867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef33ab-7688-4f87-83c1-02ff50444ac0 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:03.646748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef33ab-7688-4f87-83c1-02ff50444ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:03.647233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef33ab-7688-4f87-83c1-02ff50444ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:03.665631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e1ef33ab-7688-4f87-83c1-02ff50444ac0 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:03.667177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e1ef33ab-7688-4f87-83c1-02ff50444ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:03.744318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 485/976] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:54:03.771080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0e94b-850c-4f72-b538-812431af5751 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:03.883037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0e94b-850c-4f72-b538-812431af5751 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:03.918519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630fd71-ad95-41a2-ac79-6255931363fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:03.919648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fd71-ad95-41a2-ac79-6255931363fe None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:03.920165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fd71-ad95-41a2-ac79-6255931363fe None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:03.921752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630fd71-ad95-41a2-ac79-6255931363fe None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:03.922668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630fd71-ad95-41a2-ac79-6255931363fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:03.924385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630fd71-ad95-41a2-ac79-6255931363fe None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:03.938825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.sql.core [None req-2630fd71-ad95-41a2-ac79-6255931363fe None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 11:54:03.938825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 11:54:03.938825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [parameters: {'user_id': 'a9ffa78b97bb41b58bd4a937e668ba63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 11:54:03.938825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79870) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-2630fd71-ad95-41a2-ac79-6255931363fe None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application result = self._query(query) May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application conn.query(q) May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application result.read() May 17 11:54:03.947250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 11:54:03.948110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application next(self.gen) May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application yield resource May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application next(self.gen) May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self.session.rollback() May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self.force_reraise() May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise self.value May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application session.commit() May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 11:54:03.949211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._prepare_impl() May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self.session.flush() May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._flush(objects) May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application compat.raise_( May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application flush_context.execute() May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rec.execute(self) May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 11:54:03.950097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application result = connection._execute_20( May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 11:54:03.950988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application result = self._query(query) May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application conn.query(q) May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application result.read() May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 11:54:03.954422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a9ffa78b97bb41b58bd4a937e668ba63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:03.957313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 17 11:54:03.959320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 17 11:54:03.963383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 17 11:54:03.963383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 17 11:54:03.963383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 11:54:03.963383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 11:54:03.963383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 11:54:03.963383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:03.963383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 492/977] 10.222.0.58 () {60 vars in 1131 bytes} [Tue May 17 11:54:03 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:03.972410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef33ab-7688-4f87-83c1-02ff50444ac0 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:04.086366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef33ab-7688-4f87-83c1-02ff50444ac0 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:04.126753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7c6aa-0602-4f5b-97ea-3d260d9afdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:04.127927 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7c6aa-0602-4f5b-97ea-3d260d9afdc0 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:04.128446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7c6aa-0602-4f5b-97ea-3d260d9afdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:04.128947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7c6aa-0602-4f5b-97ea-3d260d9afdc0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:04.136878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7c6aa-0602-4f5b-97ea-3d260d9afdc0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:04.138600 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7c6aa-0602-4f5b-97ea-3d260d9afdc0 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-0fd7c6aa-0602-4f5b-97ea-3d260d9afdc0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:54:04.154075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:04.155996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:04.156982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:04.156982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:04.156982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:54:04.156982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:54:04.156982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:54:04.156982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:54:04.156982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:54:04.156982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:54:04.156982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 11:54:04.156982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:04.164067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 486/978] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:54:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:04.165897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630fd71-ad95-41a2-ac79-6255931363fe None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:04.269632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7f8ef-b47e-4ef6-a740-f8d502572668 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:04.270265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7f8ef-b47e-4ef6-a740-f8d502572668 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:04.270742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7f8ef-b47e-4ef6-a740-f8d502572668 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:04.272812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 487/979] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:04.278928 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630fd71-ad95-41a2-ac79-6255931363fe None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:04.282231 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbdfb5-6bcf-4e1e-8824-2ff03d3184d0 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:04.282647 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbdfb5-6bcf-4e1e-8824-2ff03d3184d0 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:04.283034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbdfb5-6bcf-4e1e-8824-2ff03d3184d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:04.301500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-66bbdfb5-6bcf-4e1e-8824-2ff03d3184d0 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:04.303444 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-66bbdfb5-6bcf-4e1e-8824-2ff03d3184d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:04.320204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730b9f5-fe0c-41a9-8bd1-0182d57e445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:04.320204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730b9f5-fe0c-41a9-8bd1-0182d57e445b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:04.320204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730b9f5-fe0c-41a9-8bd1-0182d57e445b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:04.320204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730b9f5-fe0c-41a9-8bd1-0182d57e445b None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:04.320632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730b9f5-fe0c-41a9-8bd1-0182d57e445b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:04.320632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730b9f5-fe0c-41a9-8bd1-0182d57e445b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:04.320632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730b9f5-fe0c-41a9-8bd1-0182d57e445b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:04.359555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 493/980] 10.222.0.58 () {56 vars in 1101 bytes} [Tue May 17 11:54:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:04.390233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 488/981] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:04.414813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730b9f5-fe0c-41a9-8bd1-0182d57e445b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:04.532743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730b9f5-fe0c-41a9-8bd1-0182d57e445b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:04.572894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47f63f-3254-42a5-9150-f781523f88d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:04.573570 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47f63f-3254-42a5-9150-f781523f88d2 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:04.573855 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47f63f-3254-42a5-9150-f781523f88d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:04.574135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47f63f-3254-42a5-9150-f781523f88d2 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:04.574863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47f63f-3254-42a5-9150-f781523f88d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:04.576256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47f63f-3254-42a5-9150-f781523f88d2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:04.590775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 494/982] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:54:04 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:54:05.115656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361badaf-1b1d-4b13-83d2-ca753b4476e6 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:05.116644 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361badaf-1b1d-4b13-83d2-ca753b4476e6 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:05.116943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361badaf-1b1d-4b13-83d2-ca753b4476e6 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:05.118498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 489/983] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:05.125209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb11bd-44b3-48b9-8081-d865fc39c834 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:05.125209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb11bd-44b3-48b9-8081-d865fc39c834 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:05.125209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb11bd-44b3-48b9-8081-d865fc39c834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:05.142347 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f8cb11bd-44b3-48b9-8081-d865fc39c834 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:05.143846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f8cb11bd-44b3-48b9-8081-d865fc39c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:05.216240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 495/984] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:05.238750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361badaf-1b1d-4b13-83d2-ca753b4476e6 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:05.335961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361badaf-1b1d-4b13-83d2-ca753b4476e6 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:05.369167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15816726-7a76-415c-ab0e-f856a890eb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:05.369883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15816726-7a76-415c-ab0e-f856a890eb11 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:05.370162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15816726-7a76-415c-ab0e-f856a890eb11 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:05.370431 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15816726-7a76-415c-ab0e-f856a890eb11 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:05.371082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15816726-7a76-415c-ab0e-f856a890eb11 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:05.372465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15816726-7a76-415c-ab0e-f856a890eb11 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-15816726-7a76-415c-ab0e-f856a890eb11 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:05.385038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:05.386055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:54:05.386904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:05.388400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 490/985] 10.222.0.58 () {56 vars in 1126 bytes} [Tue May 17 11:54:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:05.392370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb11bd-44b3-48b9-8081-d865fc39c834 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:05.494071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb11bd-44b3-48b9-8081-d865fc39c834 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:05.534422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2acb5-2053-4a8c-a392-6b061cac2d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:05.535367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2acb5-2053-4a8c-a392-6b061cac2d3c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:05.535830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2acb5-2053-4a8c-a392-6b061cac2d3c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:05.536314 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2acb5-2053-4a8c-a392-6b061cac2d3c None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:05.537032 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2acb5-2053-4a8c-a392-6b061cac2d3c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:05.537341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2acb5-2053-4a8c-a392-6b061cac2d3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:05.538711 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2acb5-2053-4a8c-a392-6b061cac2d3c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:05.543826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 496/986] 10.222.0.58 () {56 vars in 1122 bytes} [Tue May 17 11:54:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:05.549357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15816726-7a76-415c-ab0e-f856a890eb11 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:05.631524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c767c0-4b4e-4e40-8d25-986e296f3d39 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:05.631835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c767c0-4b4e-4e40-8d25-986e296f3d39 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:05.632019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c767c0-4b4e-4e40-8d25-986e296f3d39 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:05.633507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 497/987] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:54:05.638099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea966e52-fc51-4b94-9f22-0e83ec02fc82 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:05.638386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea966e52-fc51-4b94-9f22-0e83ec02fc82 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:05.638661 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea966e52-fc51-4b94-9f22-0e83ec02fc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:05.644929 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15816726-7a76-415c-ab0e-f856a890eb11 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:05.656081 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ea966e52-fc51-4b94-9f22-0e83ec02fc82 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:05.657285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ea966e52-fc51-4b94-9f22-0e83ec02fc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:05.680482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0579213-35fe-4d18-b407-98c412e9dd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:05.681475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0579213-35fe-4d18-b407-98c412e9dd71 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:05.682027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0579213-35fe-4d18-b407-98c412e9dd71 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:05.682308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0579213-35fe-4d18-b407-98c412e9dd71 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:05.683172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0579213-35fe-4d18-b407-98c412e9dd71 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:05.683788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0579213-35fe-4d18-b407-98c412e9dd71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:05.685443 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0579213-35fe-4d18-b407-98c412e9dd71 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:05.692292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 491/988] 10.222.0.58 () {56 vars in 1122 bytes} [Tue May 17 11:54:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:05.697078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0579213-35fe-4d18-b407-98c412e9dd71 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:05.729405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 498/989] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:54:05.752931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea966e52-fc51-4b94-9f22-0e83ec02fc82 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:05.797728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0579213-35fe-4d18-b407-98c412e9dd71 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:05.831088 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814b850-a960-4d2d-81c9-ba2f2856fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:05.831743 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814b850-a960-4d2d-81c9-ba2f2856fa4a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:05.832021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814b850-a960-4d2d-81c9-ba2f2856fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:05.832516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814b850-a960-4d2d-81c9-ba2f2856fa4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:05.833383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814b850-a960-4d2d-81c9-ba2f2856fa4a None admin] RBAC: Adding query filter params (interface=admin, service_id=3bc643012e214a6cb1e855c76e79837f, region_id=RegionOne) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:05.833696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814b850-a960-4d2d-81c9-ba2f2856fa4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:05.835149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814b850-a960-4d2d-81c9-ba2f2856fa4a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:05.840433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 492/990] 10.222.0.58 () {56 vars in 1249 bytes} [Tue May 17 11:54:05 2022] GET /identity/v3/endpoints?service_id=3bc643012e214a6cb1e855c76e79837f&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:05.846059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814b850-a960-4d2d-81c9-ba2f2856fa4a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:05.850755 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea966e52-fc51-4b94-9f22-0e83ec02fc82 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:05.883840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceafc89-9799-4918-aebf-dee8a209e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:05.884664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceafc89-9799-4918-aebf-dee8a209e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:05.884946 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceafc89-9799-4918-aebf-dee8a209e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:05.885220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceafc89-9799-4918-aebf-dee8a209e1c2 None admin] PATH_INFO: `/v3/services/image` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:05.885871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceafc89-9799-4918-aebf-dee8a209e1c2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:05.887248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceafc89-9799-4918-aebf-dee8a209e1c2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-dceafc89-9799-4918-aebf-dee8a209e1c2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:05.899372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:05.900419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:05.901390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 499/991] 10.222.0.58 () {56 vars in 1105 bytes} [Tue May 17 11:54:05 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:54:05.907740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceafc89-9799-4918-aebf-dee8a209e1c2 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:05.954603 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814b850-a960-4d2d-81c9-ba2f2856fa4a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:05.995034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9962c1-8bf2-4f31-9f72-ec88cf774f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:05.996124 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9962c1-8bf2-4f31-9f72-ec88cf774f48 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:05.996594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9962c1-8bf2-4f31-9f72-ec88cf774f48 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:05.996994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9962c1-8bf2-4f31-9f72-ec88cf774f48 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:05.997845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9962c1-8bf2-4f31-9f72-ec88cf774f48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:06.000688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9962c1-8bf2-4f31-9f72-ec88cf774f48 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:06.007207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceafc89-9799-4918-aebf-dee8a209e1c2 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:06.020214 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 493/992] 10.222.0.58 () {56 vars in 1087 bytes} [Tue May 17 11:54:05 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 11:54:06.041513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040162cf-3c9f-4d5b-bb76-f86f996b4ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:06.042199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040162cf-3c9f-4d5b-bb76-f86f996b4ca2 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:06.042478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040162cf-3c9f-4d5b-bb76-f86f996b4ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:06.042752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040162cf-3c9f-4d5b-bb76-f86f996b4ca2 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:06.043470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040162cf-3c9f-4d5b-bb76-f86f996b4ca2 None admin] RBAC: Adding query filter params (name=image) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:06.043774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040162cf-3c9f-4d5b-bb76-f86f996b4ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:06.045860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040162cf-3c9f-4d5b-bb76-f86f996b4ca2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:06.051596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 500/993] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:06.057321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9962c1-8bf2-4f31-9f72-ec88cf774f48 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:06.161536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9962c1-8bf2-4f31-9f72-ec88cf774f48 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:06.197859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e50b53-6d75-41a3-9edf-078c30fd64ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:06.198525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e50b53-6d75-41a3-9edf-078c30fd64ca None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:06.198809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e50b53-6d75-41a3-9edf-078c30fd64ca None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:06.199089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e50b53-6d75-41a3-9edf-078c30fd64ca None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:06.199807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e50b53-6d75-41a3-9edf-078c30fd64ca None admin] RBAC: Adding query filter params (type=image) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:06.200118 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e50b53-6d75-41a3-9edf-078c30fd64ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:06.201578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e50b53-6d75-41a3-9edf-078c30fd64ca None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:06.206355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 494/994] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:06.841590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c91420-ed83-43ff-836e-df213c2c4917 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:06.842667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c91420-ed83-43ff-836e-df213c2c4917 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:06.842667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c91420-ed83-43ff-836e-df213c2c4917 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:06.844260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 501/995] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:06.849350 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f1714-e965-4eaa-80c7-d3c606b638b3 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:06.849642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f1714-e965-4eaa-80c7-d3c606b638b3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:06.849918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f1714-e965-4eaa-80c7-d3c606b638b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:06.866887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-6b3f1714-e965-4eaa-80c7-d3c606b638b3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:06.868048 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6b3f1714-e965-4eaa-80c7-d3c606b638b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:06.933693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 495/996] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:06.957028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c91420-ed83-43ff-836e-df213c2c4917 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:07.055414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c91420-ed83-43ff-836e-df213c2c4917 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:07.088168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e1bf7-20ba-473e-a2be-124cd555aa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:07.088986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e1bf7-20ba-473e-a2be-124cd555aa2c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:07.089270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e1bf7-20ba-473e-a2be-124cd555aa2c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:07.089544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e1bf7-20ba-473e-a2be-124cd555aa2c None admin] PATH_INFO: `/v3/services/compute` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:07.090194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e1bf7-20ba-473e-a2be-124cd555aa2c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:07.091561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e1bf7-20ba-473e-a2be-124cd555aa2c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-447e1bf7-20ba-473e-a2be-124cd555aa2c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:07.103231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:07.104170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 11:54:07.105011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:07.108532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 502/997] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:54:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:07.110538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f1714-e965-4eaa-80c7-d3c606b638b3 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:07.207830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f1714-e965-4eaa-80c7-d3c606b638b3 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:07.241115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef341a6-358d-4074-bd91-e632380f2bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:07.242127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef341a6-358d-4074-bd91-e632380f2bdb None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:07.242605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef341a6-358d-4074-bd91-e632380f2bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:07.243072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef341a6-358d-4074-bd91-e632380f2bdb None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:07.244059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef341a6-358d-4074-bd91-e632380f2bdb None admin] RBAC: Adding query filter params (name=compute) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:07.244590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef341a6-358d-4074-bd91-e632380f2bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:07.246169 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef341a6-358d-4074-bd91-e632380f2bdb None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:07.251078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 496/998] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:54:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:07.256851 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e1bf7-20ba-473e-a2be-124cd555aa2c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:07.353965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e1bf7-20ba-473e-a2be-124cd555aa2c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:07.386693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ceccf-fc7f-4de8-9b21-528b99b2ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:07.387365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ceccf-fc7f-4de8-9b21-528b99b2ada8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:07.387651 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ceccf-fc7f-4de8-9b21-528b99b2ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:07.387927 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ceccf-fc7f-4de8-9b21-528b99b2ada8 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:07.388678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ceccf-fc7f-4de8-9b21-528b99b2ada8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:07.389514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ceccf-fc7f-4de8-9b21-528b99b2ada8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:07.391056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ceccf-fc7f-4de8-9b21-528b99b2ada8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:07.396018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 503/999] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:54:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:07.401969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef341a6-358d-4074-bd91-e632380f2bdb None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:07.499325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef341a6-358d-4074-bd91-e632380f2bdb None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:07.535620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6f769-6bea-41d1-9068-1d0dc57a9f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:07.536316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6f769-6bea-41d1-9068-1d0dc57a9f77 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:07.536602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6f769-6bea-41d1-9068-1d0dc57a9f77 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:07.536875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6f769-6bea-41d1-9068-1d0dc57a9f77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:07.537660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6f769-6bea-41d1-9068-1d0dc57a9f77 None admin] RBAC: Adding query filter params (interface=public, service_id=6462260904674f62a98aea86062123d9, region_id=RegionOne) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:07.537972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6f769-6bea-41d1-9068-1d0dc57a9f77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:07.539329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6f769-6bea-41d1-9068-1d0dc57a9f77 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:07.544492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 497/1000] 10.222.0.58 () {56 vars in 1251 bytes} [Tue May 17 11:54:07 2022] GET /identity/v3/endpoints?service_id=6462260904674f62a98aea86062123d9&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:07.550349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ceccf-fc7f-4de8-9b21-528b99b2ada8 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:07.644211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ceccf-fc7f-4de8-9b21-528b99b2ada8 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:07.676341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9517-3f1c-4e59-8171-272ea9452ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:07.677004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9517-3f1c-4e59-8171-272ea9452ddd None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:07.677287 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9517-3f1c-4e59-8171-272ea9452ddd None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:07.677561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9517-3f1c-4e59-8171-272ea9452ddd None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:07.678239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b9517-3f1c-4e59-8171-272ea9452ddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:07.679630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b9517-3f1c-4e59-8171-272ea9452ddd None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:07.692208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 504/1001] 10.222.0.58 () {56 vars in 1087 bytes} [Tue May 17 11:54:07 2022] GET /identity/v3/services => generated 1727 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 11:54:08.269449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387005dc-da1b-4ad9-bd6a-72051fcb91a6 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:08.269997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387005dc-da1b-4ad9-bd6a-72051fcb91a6 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:08.269997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387005dc-da1b-4ad9-bd6a-72051fcb91a6 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:08.271425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 498/1002] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:08.277649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cdc04-b251-48fc-8e59-d1fbe3042d85 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:08.278154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cdc04-b251-48fc-8e59-d1fbe3042d85 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:08.278226 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cdc04-b251-48fc-8e59-d1fbe3042d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:08.295879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7b4cdc04-b251-48fc-8e59-d1fbe3042d85 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:08.297089 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7b4cdc04-b251-48fc-8e59-d1fbe3042d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:08.362285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 505/1003] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:08.385501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387005dc-da1b-4ad9-bd6a-72051fcb91a6 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:08.452527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d63648-06ed-45eb-9c67-11831fccc275 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:08.452815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d63648-06ed-45eb-9c67-11831fccc275 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:08.453224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d63648-06ed-45eb-9c67-11831fccc275 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:08.454743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 506/1004] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:54:08.459750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c19f0-296a-495f-9736-44d174cc0f69 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:08.460037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c19f0-296a-495f-9736-44d174cc0f69 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:08.460354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c19f0-296a-495f-9736-44d174cc0f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:08.476668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-076c19f0-296a-495f-9736-44d174cc0f69 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:08.477819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-076c19f0-296a-495f-9736-44d174cc0f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:08.486183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387005dc-da1b-4ad9-bd6a-72051fcb91a6 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:08.520568 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c55e1-c051-4b3c-a533-9a2499eed1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:08.521287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c55e1-c051-4b3c-a533-9a2499eed1c0 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:08.524688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c55e1-c051-4b3c-a533-9a2499eed1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:08.524688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c55e1-c051-4b3c-a533-9a2499eed1c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:08.524688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c55e1-c051-4b3c-a533-9a2499eed1c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:08.524688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c55e1-c051-4b3c-a533-9a2499eed1c0 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-b91c55e1-c051-4b3c-a533-9a2499eed1c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:08.537405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:08.538435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:08.540018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 499/1005] 10.222.0.58 () {56 vars in 1126 bytes} [Tue May 17 11:54:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:08.544547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c55e1-c051-4b3c-a533-9a2499eed1c0 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:08.557296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 507/1006] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:54:08.579768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c19f0-296a-495f-9736-44d174cc0f69 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:08.641784 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c55e1-c051-4b3c-a533-9a2499eed1c0 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:08.674386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58bb77-0c5c-46dc-9a32-1eb25a13e77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:08.674599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c19f0-296a-495f-9736-44d174cc0f69 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:08.675056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58bb77-0c5c-46dc-9a32-1eb25a13e77d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:08.675343 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58bb77-0c5c-46dc-9a32-1eb25a13e77d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:08.675622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58bb77-0c5c-46dc-9a32-1eb25a13e77d None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:08.676358 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58bb77-0c5c-46dc-9a32-1eb25a13e77d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:08.676671 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58bb77-0c5c-46dc-9a32-1eb25a13e77d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:08.678074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58bb77-0c5c-46dc-9a32-1eb25a13e77d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:08.688232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 500/1007] 10.222.0.58 () {56 vars in 1122 bytes} [Tue May 17 11:54:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:08.689721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58bb77-0c5c-46dc-9a32-1eb25a13e77d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:08.709226 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e5b48-3c01-41ac-8868-8c94f9247ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:08.709890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e5b48-3c01-41ac-8868-8c94f9247ecc None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:08.710173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e5b48-3c01-41ac-8868-8c94f9247ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:08.710499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e5b48-3c01-41ac-8868-8c94f9247ecc None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:08.711209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e5b48-3c01-41ac-8868-8c94f9247ecc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:08.712662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e5b48-3c01-41ac-8868-8c94f9247ecc None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:08.726273 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 508/1008] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:54:08 2022] POST /identity/v3/services => generated 242 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:54:08.794376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58bb77-0c5c-46dc-9a32-1eb25a13e77d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:08.839752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a4213-f479-4203-99a7-959b6243291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:08.840469 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a4213-f479-4203-99a7-959b6243291e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:08.840760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a4213-f479-4203-99a7-959b6243291e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:08.841021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a4213-f479-4203-99a7-959b6243291e None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:08.841735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a4213-f479-4203-99a7-959b6243291e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:08.842083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a4213-f479-4203-99a7-959b6243291e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:08.843647 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a4213-f479-4203-99a7-959b6243291e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:08.849228 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 501/1009] 10.222.0.58 () {56 vars in 1122 bytes} [Tue May 17 11:54:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:08.854784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e5b48-3c01-41ac-8868-8c94f9247ecc None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:08.962157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e5b48-3c01-41ac-8868-8c94f9247ecc None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:08.995362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306b49f-5415-4baf-89db-c1d3698c9007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:08.996027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b49f-5415-4baf-89db-c1d3698c9007 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:08.996411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b49f-5415-4baf-89db-c1d3698c9007 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:08.996716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306b49f-5415-4baf-89db-c1d3698c9007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:08.997432 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306b49f-5415-4baf-89db-c1d3698c9007 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:08.998875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306b49f-5415-4baf-89db-c1d3698c9007 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:09.013753 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 509/1010] 10.222.0.58 () {60 vars in 1144 bytes} [Tue May 17 11:54:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:54:09.975787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def139d-f1a5-45bf-b0e5-adec18b45b3d None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:09.976327 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def139d-f1a5-45bf-b0e5-adec18b45b3d None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:09.976404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def139d-f1a5-45bf-b0e5-adec18b45b3d None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:09.977882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 502/1011] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:09.983865 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d117f-8bbe-4393-8f5a-3794e702077e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:09.984296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d117f-8bbe-4393-8f5a-3794e702077e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:09.984554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d117f-8bbe-4393-8f5a-3794e702077e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:10.001062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2d7d117f-8bbe-4393-8f5a-3794e702077e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:10.002251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2d7d117f-8bbe-4393-8f5a-3794e702077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:10.075321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 510/1012] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:09 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:10.099389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def139d-f1a5-45bf-b0e5-adec18b45b3d None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:10.199932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def139d-f1a5-45bf-b0e5-adec18b45b3d None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:10.233501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f5e09-fdcf-4a65-b708-7c0bbe6fa624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:10.234222 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5e09-fdcf-4a65-b708-7c0bbe6fa624 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:10.234507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5e09-fdcf-4a65-b708-7c0bbe6fa624 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:10.234791 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5e09-fdcf-4a65-b708-7c0bbe6fa624 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:10.235449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f5e09-fdcf-4a65-b708-7c0bbe6fa624 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:10.236846 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f5e09-fdcf-4a65-b708-7c0bbe6fa624 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-453f5e09-fdcf-4a65-b708-7c0bbe6fa624 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:10.248686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:10.249705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 11:54:10.250505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:10.252502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 503/1013] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:54:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:10.256122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d117f-8bbe-4393-8f5a-3794e702077e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:10.353568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d117f-8bbe-4393-8f5a-3794e702077e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:10.386246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97762c-c3fc-4d67-ad8a-32e9416c0f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:10.386917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97762c-c3fc-4d67-ad8a-32e9416c0f9f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:10.387199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97762c-c3fc-4d67-ad8a-32e9416c0f9f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:10.387476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97762c-c3fc-4d67-ad8a-32e9416c0f9f None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:10.388210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97762c-c3fc-4d67-ad8a-32e9416c0f9f None admin] RBAC: Adding query filter params (name=compute) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:10.388517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97762c-c3fc-4d67-ad8a-32e9416c0f9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:10.390597 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97762c-c3fc-4d67-ad8a-32e9416c0f9f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:10.401378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 511/1014] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:54:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:10.401525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f5e09-fdcf-4a65-b708-7c0bbe6fa624 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:10.500248 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f5e09-fdcf-4a65-b708-7c0bbe6fa624 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:10.535853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dc77a-40b5-42c1-9114-e73ac5463c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:10.536541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dc77a-40b5-42c1-9114-e73ac5463c06 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:10.536820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dc77a-40b5-42c1-9114-e73ac5463c06 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:10.537087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dc77a-40b5-42c1-9114-e73ac5463c06 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:10.537790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dc77a-40b5-42c1-9114-e73ac5463c06 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:10.538092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dc77a-40b5-42c1-9114-e73ac5463c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:10.539445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dc77a-40b5-42c1-9114-e73ac5463c06 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:10.549980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 504/1015] 10.222.0.58 () {56 vars in 1112 bytes} [Tue May 17 11:54:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:10.550956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97762c-c3fc-4d67-ad8a-32e9416c0f9f None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:10.654595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97762c-c3fc-4d67-ad8a-32e9416c0f9f None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:10.688126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13358c8-9d51-4440-a3a8-40ecbd58b864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:10.688811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13358c8-9d51-4440-a3a8-40ecbd58b864 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:10.689091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13358c8-9d51-4440-a3a8-40ecbd58b864 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:10.689362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13358c8-9d51-4440-a3a8-40ecbd58b864 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:10.690089 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13358c8-9d51-4440-a3a8-40ecbd58b864 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:10.691455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13358c8-9d51-4440-a3a8-40ecbd58b864 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:10.716218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 512/1016] 10.222.0.58 () {60 vars in 1144 bytes} [Tue May 17 11:54:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:54:10.997613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a261b5-695b-4464-a0e1-9809a8f2afb3 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:10.997613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a261b5-695b-4464-a0e1-9809a8f2afb3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:10.997613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a261b5-695b-4464-a0e1-9809a8f2afb3 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:10.997613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 505/1017] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:11.003212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c31e-f3da-4d9c-8206-4e508c3a3d2f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:11.003620 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c31e-f3da-4d9c-8206-4e508c3a3d2f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:11.003766 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c31e-f3da-4d9c-8206-4e508c3a3d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:11.020726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a4f0c31e-f3da-4d9c-8206-4e508c3a3d2f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:11.021906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a4f0c31e-f3da-4d9c-8206-4e508c3a3d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:11.095102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 513/1018] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:11.118165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a261b5-695b-4464-a0e1-9809a8f2afb3 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:11.219324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a261b5-695b-4464-a0e1-9809a8f2afb3 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:11.252677 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b24261-f500-40e3-9568-e7db96949c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:11.253376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24261-f500-40e3-9568-e7db96949c1e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:11.253653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24261-f500-40e3-9568-e7db96949c1e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:11.253925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24261-f500-40e3-9568-e7db96949c1e None admin] PATH_INFO: `/v3/services/image` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:11.254572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b24261-f500-40e3-9568-e7db96949c1e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:11.255926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b24261-f500-40e3-9568-e7db96949c1e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-44b24261-f500-40e3-9568-e7db96949c1e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:11.267193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:11.268137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:11.269016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 506/1019] 10.222.0.58 () {56 vars in 1105 bytes} [Tue May 17 11:54:11 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:11.275684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0c31e-f3da-4d9c-8206-4e508c3a3d2f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:11.275963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced65dd-6bf1-4364-a890-57e2ff637105 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:11.276272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced65dd-6bf1-4364-a890-57e2ff637105 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:11.276559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced65dd-6bf1-4364-a890-57e2ff637105 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:11.277828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 507/1020] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:11.285506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ede3-9d02-4607-a063-cf6134204090 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:11.285795 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ede3-9d02-4607-a063-cf6134204090 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:11.286080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ede3-9d02-4607-a063-cf6134204090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:11.303196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-0e74ede3-9d02-4607-a063-cf6134204090 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:11.304391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0e74ede3-9d02-4607-a063-cf6134204090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:11.370369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 508/1021] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:54:11.376488 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0c31e-f3da-4d9c-8206-4e508c3a3d2f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:11.393770 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74ede3-9d02-4607-a063-cf6134204090 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:11.409392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656c31-d979-4d6d-9c33-f05caaf153a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:11.410055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656c31-d979-4d6d-9c33-f05caaf153a8 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:11.410337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656c31-d979-4d6d-9c33-f05caaf153a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:11.410662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656c31-d979-4d6d-9c33-f05caaf153a8 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:11.411364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b656c31-d979-4d6d-9c33-f05caaf153a8 None admin] RBAC: Adding query filter params (name=image) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:11.411668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b656c31-d979-4d6d-9c33-f05caaf153a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:11.413063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b656c31-d979-4d6d-9c33-f05caaf153a8 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:11.423126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 514/1022] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:11.423960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656c31-d979-4d6d-9c33-f05caaf153a8 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:11.490207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74ede3-9d02-4607-a063-cf6134204090 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:11.521155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656c31-d979-4d6d-9c33-f05caaf153a8 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:11.533496 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589284b4-2539-45c3-848a-a5668699badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:11.534529 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589284b4-2539-45c3-848a-a5668699badb None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:11.534950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589284b4-2539-45c3-848a-a5668699badb None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:11.535360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589284b4-2539-45c3-848a-a5668699badb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:11.536730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589284b4-2539-45c3-848a-a5668699badb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:11.538149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589284b4-2539-45c3-848a-a5668699badb None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:11.539957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 509/1023] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:11.545481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589284b4-2539-45c3-848a-a5668699badb None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:11.557151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d1882-90d1-4e41-a6dd-19f9ac1c2d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:11.557813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d1882-90d1-4e41-a6dd-19f9ac1c2d5b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:11.558185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d1882-90d1-4e41-a6dd-19f9ac1c2d5b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:11.558486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d1882-90d1-4e41-a6dd-19f9ac1c2d5b None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:11.559168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d1882-90d1-4e41-a6dd-19f9ac1c2d5b None admin] RBAC: Adding query filter params (type=image) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:11.559477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d1882-90d1-4e41-a6dd-19f9ac1c2d5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:11.561382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d1882-90d1-4e41-a6dd-19f9ac1c2d5b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:11.566326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 515/1024] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:11.571976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d1882-90d1-4e41-a6dd-19f9ac1c2d5b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:11.643754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589284b4-2539-45c3-848a-a5668699badb None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:11.668787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d1882-90d1-4e41-a6dd-19f9ac1c2d5b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:11.677601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cf100-baaa-415c-83d8-013eef77cd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:11.678258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cf100-baaa-415c-83d8-013eef77cd30 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:11.678537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cf100-baaa-415c-83d8-013eef77cd30 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:11.678809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cf100-baaa-415c-83d8-013eef77cd30 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:11.679503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cf100-baaa-415c-83d8-013eef77cd30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:11.680953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cf100-baaa-415c-83d8-013eef77cd30 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:11.703707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec176c2c-f14b-48fd-8e18-c8d5d1a47cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:11.704386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176c2c-f14b-48fd-8e18-c8d5d1a47cd3 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:11.704671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176c2c-f14b-48fd-8e18-c8d5d1a47cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:11.704948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176c2c-f14b-48fd-8e18-c8d5d1a47cd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:11.705732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec176c2c-f14b-48fd-8e18-c8d5d1a47cd3 None admin] RBAC: Adding query filter params (interface=public, service_id=445e72e451b44caf9b1d31d17fb3d769, region_id=RegionOne) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:11.706043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec176c2c-f14b-48fd-8e18-c8d5d1a47cd3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:11.714239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 510/1025] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:54:11 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:54:11.714438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec176c2c-f14b-48fd-8e18-c8d5d1a47cd3 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:11.714438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 516/1026] 10.222.0.58 () {56 vars in 1251 bytes} [Tue May 17 11:54:11 2022] GET /identity/v3/endpoints?service_id=445e72e451b44caf9b1d31d17fb3d769&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:11.719668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cf100-baaa-415c-83d8-013eef77cd30 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:11.825511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cf100-baaa-415c-83d8-013eef77cd30 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:11.861477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01d24d-2f8e-4d58-860b-94bd041cdd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:11.862199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d24d-2f8e-4d58-860b-94bd041cdd96 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:11.862491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d24d-2f8e-4d58-860b-94bd041cdd96 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:11.862763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d24d-2f8e-4d58-860b-94bd041cdd96 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:11.863555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01d24d-2f8e-4d58-860b-94bd041cdd96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:11.864990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01d24d-2f8e-4d58-860b-94bd041cdd96 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:11.875668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 511/1027] 10.222.0.58 () {56 vars in 1087 bytes} [Tue May 17 11:54:11 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 11:54:13.066943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9f6b-16ed-4423-9e9c-cd25dbdcb08d None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:13.067529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9f6b-16ed-4423-9e9c-cd25dbdcb08d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:13.067529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea9f6b-16ed-4423-9e9c-cd25dbdcb08d None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:13.069050 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 517/1028] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:13.074210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4c48a-2570-4d06-996c-5ad1b2ee370f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:13.074599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4c48a-2570-4d06-996c-5ad1b2ee370f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:13.074772 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4c48a-2570-4d06-996c-5ad1b2ee370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:13.091065 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-73b4c48a-2570-4d06-996c-5ad1b2ee370f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:13.092834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-73b4c48a-2570-4d06-996c-5ad1b2ee370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:13.160227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 512/1029] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:13.180149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea9f6b-16ed-4423-9e9c-cd25dbdcb08d None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:13.280043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea9f6b-16ed-4423-9e9c-cd25dbdcb08d None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:13.312702 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e19a2-0b95-4d64-95cb-6dccc9b4afda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:13.313503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e19a2-0b95-4d64-95cb-6dccc9b4afda None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:13.313789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e19a2-0b95-4d64-95cb-6dccc9b4afda None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:13.314068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e19a2-0b95-4d64-95cb-6dccc9b4afda None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:13.323795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e19a2-0b95-4d64-95cb-6dccc9b4afda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-b22e19a2-0b95-4d64-95cb-6dccc9b4afda None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:54:13.332585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:13.333470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:13.339531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 518/1030] 10.222.0.58 () {56 vars in 1120 bytes} [Tue May 17 11:54:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:13.340547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4c48a-2570-4d06-996c-5ad1b2ee370f None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:13.437824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4c48a-2570-4d06-996c-5ad1b2ee370f None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:13.473166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdcec6-2817-41ce-a307-4f56038f4a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:13.473897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdcec6-2817-41ce-a307-4f56038f4a34 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:13.474187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdcec6-2817-41ce-a307-4f56038f4a34 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:13.474467 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcdcec6-2817-41ce-a307-4f56038f4a34 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:13.475218 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdcec6-2817-41ce-a307-4f56038f4a34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:13.475532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdcec6-2817-41ce-a307-4f56038f4a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:13.477059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcdcec6-2817-41ce-a307-4f56038f4a34 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:13.489836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 513/1031] 10.222.0.58 () {56 vars in 1115 bytes} [Tue May 17 11:54:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:13.491445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e19a2-0b95-4d64-95cb-6dccc9b4afda None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:13.594335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e19a2-0b95-4d64-95cb-6dccc9b4afda None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:13.626608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db988ce1-5fdd-4641-bf05-ca9b6c5caea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:13.627405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db988ce1-5fdd-4641-bf05-ca9b6c5caea7 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:13.627684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db988ce1-5fdd-4641-bf05-ca9b6c5caea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:13.627961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db988ce1-5fdd-4641-bf05-ca9b6c5caea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:13.638396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db988ce1-5fdd-4641-bf05-ca9b6c5caea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:13.640499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db988ce1-5fdd-4641-bf05-ca9b6c5caea7 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-db988ce1-5fdd-4641-bf05-ca9b6c5caea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:54:13.657495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:13.658412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:13.659321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:54:13.659321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:54:13.659321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:13.659321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:13.660500 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 519/1032] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:54:13.664409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdcec6-2817-41ce-a307-4f56038f4a34 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:13.761907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcdcec6-2817-41ce-a307-4f56038f4a34 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:13.794646 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41ebd5-2b55-4e9b-85b2-c8685e2ecaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:13.795957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41ebd5-2b55-4e9b-85b2-c8685e2ecaaa None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:13.796445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41ebd5-2b55-4e9b-85b2-c8685e2ecaaa None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:13.796731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41ebd5-2b55-4e9b-85b2-c8685e2ecaaa None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:13.797462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41ebd5-2b55-4e9b-85b2-c8685e2ecaaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:13.797773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41ebd5-2b55-4e9b-85b2-c8685e2ecaaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:13.799136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41ebd5-2b55-4e9b-85b2-c8685e2ecaaa None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:13.815953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 514/1033] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:13.817411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db988ce1-5fdd-4641-bf05-ca9b6c5caea7 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:13.919633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db988ce1-5fdd-4641-bf05-ca9b6c5caea7 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:13.957214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a21d5f-6baa-448a-87f8-37c5de52e49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:13.958010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a21d5f-6baa-448a-87f8-37c5de52e49f None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:13.958296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a21d5f-6baa-448a-87f8-37c5de52e49f None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:13.958575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a21d5f-6baa-448a-87f8-37c5de52e49f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:13.966431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a21d5f-6baa-448a-87f8-37c5de52e49f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:13.968245 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a21d5f-6baa-448a-87f8-37c5de52e49f None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-d5a21d5f-6baa-448a-87f8-37c5de52e49f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:54:13.982124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:13.983107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:13.990561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:13.990561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:13.990561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:54:13.990561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:54:13.990561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:54:13.990561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:54:13.990561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:54:13.990561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:54:13.990561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 11:54:13.990561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:13.990561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 520/1034] 10.222.0.58 () {56 vars in 1093 bytes} [Tue May 17 11:54:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:54:13.991301 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41ebd5-2b55-4e9b-85b2-c8685e2ecaaa None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:14.089096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41ebd5-2b55-4e9b-85b2-c8685e2ecaaa None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:14.101759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2048-0381-414f-95af-bc0d2e8550ce None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.102230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2048-0381-414f-95af-bc0d2e8550ce None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.102310 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2048-0381-414f-95af-bc0d2e8550ce None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.103682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 521/1035] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:54:14.109450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd04c-c448-4ddf-b2b7-cab20472fac3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.109741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd04c-c448-4ddf-b2b7-cab20472fac3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.110019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd04c-c448-4ddf-b2b7-cab20472fac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.125531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a9d59-bfbf-42ca-8965-9055142b83cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:14.126202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a9d59-bfbf-42ca-8965-9055142b83cb None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.126485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a9d59-bfbf-42ca-8965-9055142b83cb None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.126728 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c81dd04c-c448-4ddf-b2b7-cab20472fac3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:14.126846 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a9d59-bfbf-42ca-8965-9055142b83cb None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.127578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a9d59-bfbf-42ca-8965-9055142b83cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:14.127888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c81dd04c-c448-4ddf-b2b7-cab20472fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:14.127980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a9d59-bfbf-42ca-8965-9055142b83cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:14.129372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a9d59-bfbf-42ca-8965-9055142b83cb None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:14.146885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 515/1036] 10.222.0.58 () {56 vars in 1133 bytes} [Tue May 17 11:54:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:14.148131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108df2cf-5c76-4e2e-b7de-5b663dc7cb9a None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.148476 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108df2cf-5c76-4e2e-b7de-5b663dc7cb9a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.148754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108df2cf-5c76-4e2e-b7de-5b663dc7cb9a None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.150149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 516/1037] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:14.152379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108df2cf-5c76-4e2e-b7de-5b663dc7cb9a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:14.193242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 522/1038] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:14.194668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab20b6-72ee-46dd-852b-07ed66127078 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.195010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab20b6-72ee-46dd-852b-07ed66127078 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.195296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab20b6-72ee-46dd-852b-07ed66127078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.211045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7bab20b6-72ee-46dd-852b-07ed66127078 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:14.212250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7bab20b6-72ee-46dd-852b-07ed66127078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:14.248802 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108df2cf-5c76-4e2e-b7de-5b663dc7cb9a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:14.275680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 523/1039] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:14.276544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab20b6-72ee-46dd-852b-07ed66127078 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:14.280927 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1e5f9-c414-4f2c-b5b4-165368b276a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:14.281577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e5f9-c414-4f2c-b5b4-165368b276a6 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.281853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e5f9-c414-4f2c-b5b4-165368b276a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.282124 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e5f9-c414-4f2c-b5b4-165368b276a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.346236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1e5f9-c414-4f2c-b5b4-165368b276a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:14.347685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1e5f9-c414-4f2c-b5b4-165368b276a6 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:14.371723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab20b6-72ee-46dd-852b-07ed66127078 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:14.403659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a10ed3-914b-4746-8cd7-513ec90cb4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:14.404612 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a10ed3-914b-4746-8cd7-513ec90cb4eb None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.404902 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a10ed3-914b-4746-8cd7-513ec90cb4eb None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.405242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a10ed3-914b-4746-8cd7-513ec90cb4eb None admin] PATH_INFO: `/v3/services/image` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.405889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a10ed3-914b-4746-8cd7-513ec90cb4eb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:14.407243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a10ed3-914b-4746-8cd7-513ec90cb4eb None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-21a10ed3-914b-4746-8cd7-513ec90cb4eb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:14.418335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:14.419298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:14.420956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 524/1040] 10.222.0.58 () {56 vars in 1105 bytes} [Tue May 17 11:54:14 2022] GET /identity/v3/services/image => generated 86 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:14.422111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a10ed3-914b-4746-8cd7-513ec90cb4eb None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:14.443213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 517/1041] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:54:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:54:14.444154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1e5f9-c414-4f2c-b5b4-165368b276a6 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:14.518620 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a10ed3-914b-4746-8cd7-513ec90cb4eb None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:14.540075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1e5f9-c414-4f2c-b5b4-165368b276a6 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:14.552559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee425b-7279-4b9b-a5b6-219954cf90c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:14.553345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee425b-7279-4b9b-a5b6-219954cf90c5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.553622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee425b-7279-4b9b-a5b6-219954cf90c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.553889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee425b-7279-4b9b-a5b6-219954cf90c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.555039 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee425b-7279-4b9b-a5b6-219954cf90c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:14.556502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee425b-7279-4b9b-a5b6-219954cf90c5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:14.558095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 525/1042] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:14.558840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee425b-7279-4b9b-a5b6-219954cf90c5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:14.572499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a7850-1f5f-40cf-8961-2891d6afc4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:14.573151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7850-1f5f-40cf-8961-2891d6afc4c5 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.573428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7850-1f5f-40cf-8961-2891d6afc4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.573696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7850-1f5f-40cf-8961-2891d6afc4c5 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.574390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a7850-1f5f-40cf-8961-2891d6afc4c5 None admin] RBAC: Adding query filter params (name=image) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:14.574692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a7850-1f5f-40cf-8961-2891d6afc4c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:14.576036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a7850-1f5f-40cf-8961-2891d6afc4c5 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:14.581324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 518/1043] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:14.582067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a7850-1f5f-40cf-8961-2891d6afc4c5 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:14.656915 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee425b-7279-4b9b-a5b6-219954cf90c5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:14.679581 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a7850-1f5f-40cf-8961-2891d6afc4c5 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:14.690275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacc520-3827-41e1-99a7-4aa603cf8709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:14.691061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc520-3827-41e1-99a7-4aa603cf8709 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.691372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc520-3827-41e1-99a7-4aa603cf8709 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.691644 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacc520-3827-41e1-99a7-4aa603cf8709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.703343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacc520-3827-41e1-99a7-4aa603cf8709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:14.704753 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacc520-3827-41e1-99a7-4aa603cf8709 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:14.712625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8c139-430c-41c5-a4f6-bde3a6a1f25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:14.713282 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8c139-430c-41c5-a4f6-bde3a6a1f25a None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.713612 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8c139-430c-41c5-a4f6-bde3a6a1f25a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.713897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8c139-430c-41c5-a4f6-bde3a6a1f25a None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.714602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8c139-430c-41c5-a4f6-bde3a6a1f25a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:14.716039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8c139-430c-41c5-a4f6-bde3a6a1f25a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-4bacc520-3827-41e1-99a7-4aa603cf8709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:54:14.721304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:14.722235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:14.723118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:54:14.723118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:54:14.723118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:14.723118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:14.723118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 526/1044] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:14.723393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacc520-3827-41e1-99a7-4aa603cf8709 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:14.743194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 519/1045] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:54:14 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:54:14.743194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8c139-430c-41c5-a4f6-bde3a6a1f25a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:14.839260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacc520-3827-41e1-99a7-4aa603cf8709 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:14.843436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8c139-430c-41c5-a4f6-bde3a6a1f25a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:14.875052 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4f9f-8e0d-4eca-aa3a-20057164b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:14.875768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4f9f-8e0d-4eca-aa3a-20057164b9ad None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.876051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4f9f-8e0d-4eca-aa3a-20057164b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.876363 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4f9f-8e0d-4eca-aa3a-20057164b9ad None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.877089 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac4f9f-8e0d-4eca-aa3a-20057164b9ad None admin] RBAC: Adding query filter params (type=image) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:14.877401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac4f9f-8e0d-4eca-aa3a-20057164b9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:14.878800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac4f9f-8e0d-4eca-aa3a-20057164b9ad None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:14.879144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697964a-8247-41f0-96e8-233c0d2fb067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:14.879824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697964a-8247-41f0-96e8-233c0d2fb067 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:14.880287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697964a-8247-41f0-96e8-233c0d2fb067 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:14.880452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697964a-8247-41f0-96e8-233c0d2fb067 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:14.881147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697964a-8247-41f0-96e8-233c0d2fb067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:14.881463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697964a-8247-41f0-96e8-233c0d2fb067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:14.882837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697964a-8247-41f0-96e8-233c0d2fb067 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:14.889672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 527/1046] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:14.890591 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4f9f-8e0d-4eca-aa3a-20057164b9ad None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:14.901235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 520/1047] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:14.902233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697964a-8247-41f0-96e8-233c0d2fb067 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:15.000901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4f9f-8e0d-4eca-aa3a-20057164b9ad None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:15.009982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697964a-8247-41f0-96e8-233c0d2fb067 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:15.032850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ce072-283a-4419-ad33-abb2a59da44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:15.033510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ce072-283a-4419-ad33-abb2a59da44e None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:15.033792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ce072-283a-4419-ad33-abb2a59da44e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:15.034065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ce072-283a-4419-ad33-abb2a59da44e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:15.034793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ce072-283a-4419-ad33-abb2a59da44e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:15.036167 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ce072-283a-4419-ad33-abb2a59da44e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:15.044059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11705a-5697-4bc6-9b17-24c96be811d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:15.045410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11705a-5697-4bc6-9b17-24c96be811d1 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:15.045760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11705a-5697-4bc6-9b17-24c96be811d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:15.046088 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11705a-5697-4bc6-9b17-24c96be811d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:15.053616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11705a-5697-4bc6-9b17-24c96be811d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:15.055052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11705a-5697-4bc6-9b17-24c96be811d1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:15.060218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 528/1048] 10.222.0.58 () {60 vars in 1144 bytes} [Tue May 17 11:54:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-9c11705a-5697-4bc6-9b17-24c96be811d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:54:15.069558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:15.070567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:15.071462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:54:15.071462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:54:15.071462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:54:15.071462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:54:15.071462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:54:15.071462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:54:15.071462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:54:15.071462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:15.071462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 521/1049] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:54:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:15.077560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ce072-283a-4419-ad33-abb2a59da44e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:15.189979 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ce072-283a-4419-ad33-abb2a59da44e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:15.227119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd1594-709a-4b36-a110-285009098a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:15.228233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd1594-709a-4b36-a110-285009098a60 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:15.228717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd1594-709a-4b36-a110-285009098a60 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:15.229189 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd1594-709a-4b36-a110-285009098a60 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:15.230179 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd1594-709a-4b36-a110-285009098a60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:15.230699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd1594-709a-4b36-a110-285009098a60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:15.232392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd1594-709a-4b36-a110-285009098a60 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:15.245999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 529/1050] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:54:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:15.252772 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11705a-5697-4bc6-9b17-24c96be811d1 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:15.355555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11705a-5697-4bc6-9b17-24c96be811d1 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:15.390766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae0f67-79de-4ef3-a386-754f1b5fa825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:15.391422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0f67-79de-4ef3-a386-754f1b5fa825 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:15.391699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0f67-79de-4ef3-a386-754f1b5fa825 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:15.391972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0f67-79de-4ef3-a386-754f1b5fa825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:15.392823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae0f67-79de-4ef3-a386-754f1b5fa825 None admin] RBAC: Adding query filter params (role.id=06c32961ffa44ca7ab91a257468ae7d4, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=d86479ff40f54e7793f1771cb6ad362a) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:15.393135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae0f67-79de-4ef3-a386-754f1b5fa825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:15.394553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae0f67-79de-4ef3-a386-754f1b5fa825 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:15.404244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 522/1051] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:54:15 2022] GET /identity/v3/role_assignments?user.id=d86479ff40f54e7793f1771cb6ad362a&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=06c32961ffa44ca7ab91a257468ae7d4 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:17.054405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff0875-da7f-4d1a-8251-88bc377eb0e2 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.054956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff0875-da7f-4d1a-8251-88bc377eb0e2 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.054956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff0875-da7f-4d1a-8251-88bc377eb0e2 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.056491 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 530/1052] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:17.062275 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6babe-3fcd-4c3b-956a-b133b59c379a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.062670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6babe-3fcd-4c3b-956a-b133b59c379a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.062848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6babe-3fcd-4c3b-956a-b133b59c379a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.079962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-c2f6babe-3fcd-4c3b-956a-b133b59c379a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:17.081178 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c2f6babe-3fcd-4c3b-956a-b133b59c379a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:17.147846 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 523/1053] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:17.172280 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff0875-da7f-4d1a-8251-88bc377eb0e2 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:17.271219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff0875-da7f-4d1a-8251-88bc377eb0e2 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:17.304040 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c9fb0-24e2-46cf-af24-0b5f08d8e407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:17.304908 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c9fb0-24e2-46cf-af24-0b5f08d8e407 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.305146 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c9fb0-24e2-46cf-af24-0b5f08d8e407 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.305424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c9fb0-24e2-46cf-af24-0b5f08d8e407 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.315790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c9fb0-24e2-46cf-af24-0b5f08d8e407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-d76c9fb0-24e2-46cf-af24-0b5f08d8e407 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:54:17.323444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:17.324616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:17.325486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:17.328502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 531/1054] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:54:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:17.330890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c9fb0-24e2-46cf-af24-0b5f08d8e407 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:17.331140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bf772-8f8b-4f8c-b237-7708aab1d1ed None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.331430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bf772-8f8b-4f8c-b237-7708aab1d1ed None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.331710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bf772-8f8b-4f8c-b237-7708aab1d1ed None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.333201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 524/1055] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:17.338330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843477e5-3f44-4fde-b7c7-7c675656b1de None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.338624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843477e5-3f44-4fde-b7c7-7c675656b1de None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.338922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843477e5-3f44-4fde-b7c7-7c675656b1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.355992 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-843477e5-3f44-4fde-b7c7-7c675656b1de None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:17.357207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-843477e5-3f44-4fde-b7c7-7c675656b1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:17.425889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 525/1056] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:54:17.433173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c9fb0-24e2-46cf-af24-0b5f08d8e407 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:17.448360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843477e5-3f44-4fde-b7c7-7c675656b1de None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:17.470882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87208aab-b8c1-4836-a638-6d1fb75bec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:17.471802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87208aab-b8c1-4836-a638-6d1fb75bec56 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.472254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87208aab-b8c1-4836-a638-6d1fb75bec56 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.472681 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87208aab-b8c1-4836-a638-6d1fb75bec56 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.473617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87208aab-b8c1-4836-a638-6d1fb75bec56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:17.474071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87208aab-b8c1-4836-a638-6d1fb75bec56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:17.475639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87208aab-b8c1-4836-a638-6d1fb75bec56 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:17.485020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 532/1057] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:54:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:17.490945 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87208aab-b8c1-4836-a638-6d1fb75bec56 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:17.549829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843477e5-3f44-4fde-b7c7-7c675656b1de None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:17.584421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebda198-eaa8-4067-9763-1d975e5ff373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:17.584995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebda198-eaa8-4067-9763-1d975e5ff373 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.585277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebda198-eaa8-4067-9763-1d975e5ff373 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.585707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebda198-eaa8-4067-9763-1d975e5ff373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.590992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87208aab-b8c1-4836-a638-6d1fb75bec56 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:17.625093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff6065-4e36-4441-ad27-97adeddd1453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:17.625956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff6065-4e36-4441-ad27-97adeddd1453 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.626239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff6065-4e36-4441-ad27-97adeddd1453 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.626517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff6065-4e36-4441-ad27-97adeddd1453 None admin] PATH_INFO: `/v3/users/cba5da2de2f644058af448be2eac2e4d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.640691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff6065-4e36-4441-ad27-97adeddd1453 None admin] RBAC: Authorizing `identity:get_user(user_id=cba5da2de2f644058af448be2eac2e4d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:17.642135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff6065-4e36-4441-ad27-97adeddd1453 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:17.643788 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 533/1058] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:17 2022] GET /identity/v3/users/cba5da2de2f644058af448be2eac2e4d => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:17.645026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea34c-3468-4d71-a192-ff0fdef9482d None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.645315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea34c-3468-4d71-a192-ff0fdef9482d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.645593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea34c-3468-4d71-a192-ff0fdef9482d None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.648212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 534/1059] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:17.649513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ea34c-3468-4d71-a192-ff0fdef9482d None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:17.651074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebda198-eaa8-4067-9763-1d975e5ff373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:17.652590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebda198-eaa8-4067-9763-1d975e5ff373 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:17.743271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ea34c-3468-4d71-a192-ff0fdef9482d None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:17.745939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 526/1060] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:54:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 11:54:17.747221 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01593b22-3c08-4bf0-a1f6-98946fc78aeb None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.747512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01593b22-3c08-4bf0-a1f6-98946fc78aeb None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.747791 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01593b22-3c08-4bf0-a1f6-98946fc78aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.764369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-01593b22-3c08-4bf0-a1f6-98946fc78aeb None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:17.765545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-01593b22-3c08-4bf0-a1f6-98946fc78aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:17.776622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86838d93-59d8-400f-b13f-1ea451273ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:17.777269 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86838d93-59d8-400f-b13f-1ea451273ea7 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.777553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86838d93-59d8-400f-b13f-1ea451273ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.777827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86838d93-59d8-400f-b13f-1ea451273ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.830414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 527/1061] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:17.831256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01593b22-3c08-4bf0-a1f6-98946fc78aeb None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:17.845080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86838d93-59d8-400f-b13f-1ea451273ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:17.846480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86838d93-59d8-400f-b13f-1ea451273ea7 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:17.927272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01593b22-3c08-4bf0-a1f6-98946fc78aeb None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:17.938707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 535/1062] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:54:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 11:54:17.939534 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86838d93-59d8-400f-b13f-1ea451273ea7 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:17.960107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9de20-ee96-4944-86e3-312ed6c9534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:17.960920 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9de20-ee96-4944-86e3-312ed6c9534b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:17.961199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9de20-ee96-4944-86e3-312ed6c9534b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:17.961469 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9de20-ee96-4944-86e3-312ed6c9534b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:17.972136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9de20-ee96-4944-86e3-312ed6c9534b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:17.973595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9de20-ee96-4944-86e3-312ed6c9534b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-13d9de20-ee96-4944-86e3-312ed6c9534b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:54:17.989936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:17.990817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:17.991699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:54:17.991699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:54:17.991699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:17.991699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:17.992341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 528/1063] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:17.993239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9de20-ee96-4944-86e3-312ed6c9534b None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:18.033056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86838d93-59d8-400f-b13f-1ea451273ea7 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:18.064807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d43e74-79ec-4a76-869f-8784765fe8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:18.065606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d43e74-79ec-4a76-869f-8784765fe8f6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:18.065891 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d43e74-79ec-4a76-869f-8784765fe8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:18.066158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d43e74-79ec-4a76-869f-8784765fe8f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:18.075854 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d43e74-79ec-4a76-869f-8784765fe8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-a3d43e74-79ec-4a76-869f-8784765fe8f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:54:18.084545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:18.085650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:54:18.086670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:18.087883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9de20-ee96-4944-86e3-312ed6c9534b None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:18.088471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 536/1064] 10.222.0.58 () {56 vars in 1120 bytes} [Tue May 17 11:54:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:18.089475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d43e74-79ec-4a76-869f-8784765fe8f6 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:18.120684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8ddf5-17aa-46e5-936b-9d264ff0bf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:18.121463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8ddf5-17aa-46e5-936b-9d264ff0bf44 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:18.121743 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8ddf5-17aa-46e5-936b-9d264ff0bf44 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:18.122017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8ddf5-17aa-46e5-936b-9d264ff0bf44 None admin] PATH_INFO: `/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:18.123308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8ddf5-17aa-46e5-936b-9d264ff0bf44 None admin] RBAC: Authorizing `identity:get_project(project_id=5155a8e962544cb49ec347cbaf5dcd4d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:18.124775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8ddf5-17aa-46e5-936b-9d264ff0bf44 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:18.126459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 529/1065] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:54:17 2022] GET /identity/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:18.127217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8ddf5-17aa-46e5-936b-9d264ff0bf44 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:18.184009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d43e74-79ec-4a76-869f-8784765fe8f6 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:18.215104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b4815-2dbc-46e2-b4bf-0aa446173f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:18.215844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b4815-2dbc-46e2-b4bf-0aa446173f55 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:18.216206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b4815-2dbc-46e2-b4bf-0aa446173f55 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:18.216497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b4815-2dbc-46e2-b4bf-0aa446173f55 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:18.217340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b4815-2dbc-46e2-b4bf-0aa446173f55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:18.217644 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b4815-2dbc-46e2-b4bf-0aa446173f55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:18.219000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b4815-2dbc-46e2-b4bf-0aa446173f55 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:18.222558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8ddf5-17aa-46e5-936b-9d264ff0bf44 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:18.230048 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 537/1066] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:18.230834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b4815-2dbc-46e2-b4bf-0aa446173f55 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:18.259238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef96538-afec-47b7-bc96-5999bade0f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:18.259931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef96538-afec-47b7-bc96-5999bade0f09 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:18.260239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef96538-afec-47b7-bc96-5999bade0f09 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:18.260519 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef96538-afec-47b7-bc96-5999bade0f09 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:18.261298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef96538-afec-47b7-bc96-5999bade0f09 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:18.261610 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef96538-afec-47b7-bc96-5999bade0f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:18.263148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef96538-afec-47b7-bc96-5999bade0f09 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:18.277388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 530/1067] 10.222.0.58 () {56 vars in 1115 bytes} [Tue May 17 11:54:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:18.278161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef96538-afec-47b7-bc96-5999bade0f09 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:18.347297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b4815-2dbc-46e2-b4bf-0aa446173f55 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:18.383652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef96538-afec-47b7-bc96-5999bade0f09 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:18.387892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef2424-8313-493e-b45a-4a8db46ce514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:18.389302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2424-8313-493e-b45a-4a8db46ce514 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:18.389690 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2424-8313-493e-b45a-4a8db46ce514 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:18.389969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2424-8313-493e-b45a-4a8db46ce514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:18.390824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef2424-8313-493e-b45a-4a8db46ce514 None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=5155a8e962544cb49ec347cbaf5dcd4d, user.id=cba5da2de2f644058af448be2eac2e4d) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:18.391140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef2424-8313-493e-b45a-4a8db46ce514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:18.392662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef2424-8313-493e-b45a-4a8db46ce514 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:18.398632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 538/1068] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:54:18 2022] GET /identity/v3/role_assignments?user.id=cba5da2de2f644058af448be2eac2e4d&scope.project.id=5155a8e962544cb49ec347cbaf5dcd4d&role.id=3db33dfd3d6544fd81933007633fc56a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:18.434118 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65607350-8a58-4ac3-bdd1-f22696c7c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:18.434945 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65607350-8a58-4ac3-bdd1-f22696c7c47b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:18.435225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65607350-8a58-4ac3-bdd1-f22696c7c47b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:18.436351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65607350-8a58-4ac3-bdd1-f22696c7c47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:18.448937 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65607350-8a58-4ac3-bdd1-f22696c7c47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:18.450418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65607350-8a58-4ac3-bdd1-f22696c7c47b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-65607350-8a58-4ac3-bdd1-f22696c7c47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:54:18.470811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:18.471741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:18.472761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:54:18.472761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:54:18.472761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:18.472761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:18.473471 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 531/1069] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:54:18.478513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef2424-8313-493e-b45a-4a8db46ce514 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:18.588893 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef2424-8313-493e-b45a-4a8db46ce514 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:18.623772 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125c79-4a4f-414a-983e-98f3d3c06204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:18.624471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125c79-4a4f-414a-983e-98f3d3c06204 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:18.624759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125c79-4a4f-414a-983e-98f3d3c06204 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:18.625036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125c79-4a4f-414a-983e-98f3d3c06204 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:18.625754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8125c79-4a4f-414a-983e-98f3d3c06204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:18.626062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8125c79-4a4f-414a-983e-98f3d3c06204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:18.627428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8125c79-4a4f-414a-983e-98f3d3c06204 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:18.638338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 539/1070] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:18.644641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65607350-8a58-4ac3-bdd1-f22696c7c47b None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:18.740271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65607350-8a58-4ac3-bdd1-f22696c7c47b None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:18.772060 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e556c31-343f-4e01-b067-3f5516ff8016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:18.772866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e556c31-343f-4e01-b067-3f5516ff8016 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:18.773148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e556c31-343f-4e01-b067-3f5516ff8016 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:18.773422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e556c31-343f-4e01-b067-3f5516ff8016 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:18.781271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e556c31-343f-4e01-b067-3f5516ff8016 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:18.782697 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e556c31-343f-4e01-b067-3f5516ff8016 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-1e556c31-343f-4e01-b067-3f5516ff8016 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:54:18.796555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:18.797618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:18.798626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:18.798626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:18.798626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:54:18.798626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:54:18.798626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:54:18.798626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:54:18.798626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:54:18.798626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:54:18.798626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 11:54:18.798626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:18.798626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 532/1071] 10.222.0.58 () {56 vars in 1093 bytes} [Tue May 17 11:54:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:18.803522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125c79-4a4f-414a-983e-98f3d3c06204 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:18.897903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125c79-4a4f-414a-983e-98f3d3c06204 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:18.929817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847200d-a071-402b-816a-10b36e948144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:18.930480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847200d-a071-402b-816a-10b36e948144 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:18.930765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847200d-a071-402b-816a-10b36e948144 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:18.931038 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847200d-a071-402b-816a-10b36e948144 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:18.931859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847200d-a071-402b-816a-10b36e948144 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:18.932164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847200d-a071-402b-816a-10b36e948144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:18.933604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847200d-a071-402b-816a-10b36e948144 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:18.950472 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 540/1072] 10.222.0.58 () {56 vars in 1133 bytes} [Tue May 17 11:54:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:18.956173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e556c31-343f-4e01-b067-3f5516ff8016 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:19.059785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e556c31-343f-4e01-b067-3f5516ff8016 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:19.098470 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079c0a-343a-4c16-bccc-d36bc379316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:19.099632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079c0a-343a-4c16-bccc-d36bc379316d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:19.100044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079c0a-343a-4c16-bccc-d36bc379316d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:19.100489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079c0a-343a-4c16-bccc-d36bc379316d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:19.113773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96079c0a-343a-4c16-bccc-d36bc379316d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:19.116017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96079c0a-343a-4c16-bccc-d36bc379316d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-96079c0a-343a-4c16-bccc-d36bc379316d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:54:19.133392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:19.134420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:19.140762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:54:19.140762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:54:19.140762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:19.140762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:19.140762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 533/1073] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:19.141046 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847200d-a071-402b-816a-10b36e948144 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:19.236266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847200d-a071-402b-816a-10b36e948144 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:19.269868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f392d-df40-4e7f-bf7f-6570d39534ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:19.270528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f392d-df40-4e7f-bf7f-6570d39534ef None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:19.270812 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f392d-df40-4e7f-bf7f-6570d39534ef None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:19.271086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f392d-df40-4e7f-bf7f-6570d39534ef None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:19.271803 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f392d-df40-4e7f-bf7f-6570d39534ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:19.272112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f392d-df40-4e7f-bf7f-6570d39534ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:19.273506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f392d-df40-4e7f-bf7f-6570d39534ef None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:19.284745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 541/1074] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:19.290275 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079c0a-343a-4c16-bccc-d36bc379316d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:19.384063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079c0a-343a-4c16-bccc-d36bc379316d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:19.417234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734788a4-37c4-400b-9db8-f13664995328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:19.418015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734788a4-37c4-400b-9db8-f13664995328 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:19.418296 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734788a4-37c4-400b-9db8-f13664995328 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:19.418569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734788a4-37c4-400b-9db8-f13664995328 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:19.425062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734788a4-37c4-400b-9db8-f13664995328 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:19.426489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734788a4-37c4-400b-9db8-f13664995328 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-734788a4-37c4-400b-9db8-f13664995328 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:54:19.440692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:19.441576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:19.442442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:54:19.442442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:54:19.442442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:54:19.442442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:54:19.442442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:54:19.442442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:54:19.442442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:54:19.442442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:19.442442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 534/1075] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:54:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:19.447858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f392d-df40-4e7f-bf7f-6570d39534ef None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:19.544235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f392d-df40-4e7f-bf7f-6570d39534ef None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:19.575882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3730d-5956-4694-96c3-8690611cfaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:19.577165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3730d-5956-4694-96c3-8690611cfaae None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:19.577454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3730d-5956-4694-96c3-8690611cfaae None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:19.577730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3730d-5956-4694-96c3-8690611cfaae None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:19.578511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3730d-5956-4694-96c3-8690611cfaae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:19.578824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3730d-5956-4694-96c3-8690611cfaae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:19.580279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3730d-5956-4694-96c3-8690611cfaae None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:19.592669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 542/1076] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:54:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:19.598339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734788a4-37c4-400b-9db8-f13664995328 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:19.691292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734788a4-37c4-400b-9db8-f13664995328 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:19.723777 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7637ab-6537-4026-8f88-e40dcbf766bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:19.724694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7637ab-6537-4026-8f88-e40dcbf766bf None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:19.724974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7637ab-6537-4026-8f88-e40dcbf766bf None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:19.725248 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7637ab-6537-4026-8f88-e40dcbf766bf None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/d86479ff40f54e7793f1771cb6ad362a/roles/06c32961ffa44ca7ab91a257468ae7d4` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:19.727391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7637ab-6537-4026-8f88-e40dcbf766bf None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=d86479ff40f54e7793f1771cb6ad362a, role_id=06c32961ffa44ca7ab91a257468ae7d4)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:19.728907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7637ab-6537-4026-8f88-e40dcbf766bf None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:19.742132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 535/1077] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:54:19 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/d86479ff40f54e7793f1771cb6ad362a/roles/06c32961ffa44ca7ab91a257468ae7d4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:54:20.645387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba503ebd-b216-47b5-80ae-94c5965558bc None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:20.645930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba503ebd-b216-47b5-80ae-94c5965558bc None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:20.646025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba503ebd-b216-47b5-80ae-94c5965558bc None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:20.647362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 543/1078] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:20.652722 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a333f-c28b-4e4d-952e-8173bf7de260 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:20.653162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a333f-c28b-4e4d-952e-8173bf7de260 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:20.653315 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a333f-c28b-4e4d-952e-8173bf7de260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:20.670747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-b52a333f-c28b-4e4d-952e-8173bf7de260 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:20.672054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b52a333f-c28b-4e4d-952e-8173bf7de260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:20.735621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 536/1079] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:20.757716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba503ebd-b216-47b5-80ae-94c5965558bc None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:20.855177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba503ebd-b216-47b5-80ae-94c5965558bc None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:20.889306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d6a09-b3ae-4887-aef6-d19acd505f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:20.890082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d6a09-b3ae-4887-aef6-d19acd505f12 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:20.890366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d6a09-b3ae-4887-aef6-d19acd505f12 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:20.890638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d6a09-b3ae-4887-aef6-d19acd505f12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:20.900426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d6a09-b3ae-4887-aef6-d19acd505f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-829d6a09-b3ae-4887-aef6-d19acd505f12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:54:20.909000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:20.909970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:20.910829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 544/1080] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:54:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:20.916161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a333f-c28b-4e4d-952e-8173bf7de260 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:21.011701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a333f-c28b-4e4d-952e-8173bf7de260 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:21.043330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86119f2-a1a4-43cc-bfb3-387b7b75f304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:21.043992 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86119f2-a1a4-43cc-bfb3-387b7b75f304 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:21.044306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86119f2-a1a4-43cc-bfb3-387b7b75f304 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:21.044583 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86119f2-a1a4-43cc-bfb3-387b7b75f304 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:21.045859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86119f2-a1a4-43cc-bfb3-387b7b75f304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:21.046172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86119f2-a1a4-43cc-bfb3-387b7b75f304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:21.047542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86119f2-a1a4-43cc-bfb3-387b7b75f304 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:21.055290 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 537/1081] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:54:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:21.061817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d6a09-b3ae-4887-aef6-d19acd505f12 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:21.155200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d6a09-b3ae-4887-aef6-d19acd505f12 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:21.187296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865f4ca-500d-4841-b34f-2b69c62c8a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:21.188144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865f4ca-500d-4841-b34f-2b69c62c8a45 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:21.188459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865f4ca-500d-4841-b34f-2b69c62c8a45 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:21.188735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865f4ca-500d-4841-b34f-2b69c62c8a45 None admin] PATH_INFO: `/v3/users/cba5da2de2f644058af448be2eac2e4d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:21.189905 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865f4ca-500d-4841-b34f-2b69c62c8a45 None admin] RBAC: Authorizing `identity:get_user(user_id=cba5da2de2f644058af448be2eac2e4d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:21.191348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865f4ca-500d-4841-b34f-2b69c62c8a45 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:21.192989 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 545/1082] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:21 2022] GET /identity/v3/users/cba5da2de2f644058af448be2eac2e4d => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:21.198656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86119f2-a1a4-43cc-bfb3-387b7b75f304 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:21.292687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86119f2-a1a4-43cc-bfb3-387b7b75f304 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:21.324838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387d092-bed9-4f0d-bf9d-8b10ff9f3878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:21.325684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387d092-bed9-4f0d-bf9d-8b10ff9f3878 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:21.325958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387d092-bed9-4f0d-bf9d-8b10ff9f3878 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:21.326766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387d092-bed9-4f0d-bf9d-8b10ff9f3878 None admin] PATH_INFO: `/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:21.327916 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387d092-bed9-4f0d-bf9d-8b10ff9f3878 None admin] RBAC: Authorizing `identity:get_project(project_id=5155a8e962544cb49ec347cbaf5dcd4d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:21.329370 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387d092-bed9-4f0d-bf9d-8b10ff9f3878 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:21.331033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 538/1083] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:54:21 2022] GET /identity/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:21.336872 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865f4ca-500d-4841-b34f-2b69c62c8a45 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:21.431839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865f4ca-500d-4841-b34f-2b69c62c8a45 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:21.465256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226976c0-d653-49f6-a4b7-ba23051a8aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:21.466135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226976c0-d653-49f6-a4b7-ba23051a8aa1 None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:21.466414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226976c0-d653-49f6-a4b7-ba23051a8aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:21.466688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226976c0-d653-49f6-a4b7-ba23051a8aa1 None admin] PATH_INFO: `/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d/users/cba5da2de2f644058af448be2eac2e4d/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:21.468637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226976c0-d653-49f6-a4b7-ba23051a8aa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5155a8e962544cb49ec347cbaf5dcd4d, user_id=cba5da2de2f644058af448be2eac2e4d, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:21.470062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226976c0-d653-49f6-a4b7-ba23051a8aa1 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:21.482787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 546/1084] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:54:21 2022] PUT /identity/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d/users/cba5da2de2f644058af448be2eac2e4d/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:54:21.957351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa083f-4ba9-4f1f-952b-a51087ec567a None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:21.957898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa083f-4ba9-4f1f-952b-a51087ec567a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:21.957898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa083f-4ba9-4f1f-952b-a51087ec567a None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:21.959279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 539/1085] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:21.964608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8083d-649f-4744-80de-1e065bb1ace5 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:21.964986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8083d-649f-4744-80de-1e065bb1ace5 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:21.965174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8083d-649f-4744-80de-1e065bb1ace5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:21.981890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f4a8083d-649f-4744-80de-1e065bb1ace5 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:21.983739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f4a8083d-649f-4744-80de-1e065bb1ace5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:22.048166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 547/1086] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:22.071685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa083f-4ba9-4f1f-952b-a51087ec567a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:22.166740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa083f-4ba9-4f1f-952b-a51087ec567a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:22.198401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762623c0-b9bb-40bb-b9da-419f340539a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:22.199196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762623c0-b9bb-40bb-b9da-419f340539a6 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:22.199475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762623c0-b9bb-40bb-b9da-419f340539a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:22.199752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762623c0-b9bb-40bb-b9da-419f340539a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:22.210169 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762623c0-b9bb-40bb-b9da-419f340539a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-762623c0-b9bb-40bb-b9da-419f340539a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:54:22.218839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:22.219749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:22.220623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 540/1087] 10.222.0.58 () {56 vars in 1120 bytes} [Tue May 17 11:54:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:22.226023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8083d-649f-4744-80de-1e065bb1ace5 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:22.319350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8083d-649f-4744-80de-1e065bb1ace5 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:22.351168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab713e35-f651-4a11-b672-4352a4ecdaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:22.351823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab713e35-f651-4a11-b672-4352a4ecdaf9 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:22.352103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab713e35-f651-4a11-b672-4352a4ecdaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:22.352403 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab713e35-f651-4a11-b672-4352a4ecdaf9 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:22.353136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab713e35-f651-4a11-b672-4352a4ecdaf9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:22.353439 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab713e35-f651-4a11-b672-4352a4ecdaf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:22.354800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab713e35-f651-4a11-b672-4352a4ecdaf9 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:22.362305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 548/1088] 10.222.0.58 () {56 vars in 1115 bytes} [Tue May 17 11:54:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:22.367915 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762623c0-b9bb-40bb-b9da-419f340539a6 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:22.461683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762623c0-b9bb-40bb-b9da-419f340539a6 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:22.493773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869b871-70a7-45bf-a3c1-16c740e4f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:22.494547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869b871-70a7-45bf-a3c1-16c740e4f992 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:22.494821 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869b871-70a7-45bf-a3c1-16c740e4f992 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:22.495093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869b871-70a7-45bf-a3c1-16c740e4f992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:22.505871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869b871-70a7-45bf-a3c1-16c740e4f992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:22.507297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869b871-70a7-45bf-a3c1-16c740e4f992 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-d869b871-70a7-45bf-a3c1-16c740e4f992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:54:22.535909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:22.537007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:22.537900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:54:22.537900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:54:22.537900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:22.537900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:22.537900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 541/1089] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:54:22.542817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab713e35-f651-4a11-b672-4352a4ecdaf9 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:22.649001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab713e35-f651-4a11-b672-4352a4ecdaf9 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:22.694161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35468490-9988-4e5b-8116-af483a9a3aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:22.694828 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35468490-9988-4e5b-8116-af483a9a3aa2 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:22.695107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35468490-9988-4e5b-8116-af483a9a3aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:22.695379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35468490-9988-4e5b-8116-af483a9a3aa2 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:22.696107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35468490-9988-4e5b-8116-af483a9a3aa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:22.696435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35468490-9988-4e5b-8116-af483a9a3aa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:22.697793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35468490-9988-4e5b-8116-af483a9a3aa2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:22.710318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 549/1090] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:22.716331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869b871-70a7-45bf-a3c1-16c740e4f992 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:22.832421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869b871-70a7-45bf-a3c1-16c740e4f992 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:22.866670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc06e4-390c-4eb6-ad7d-81ac9d38acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:22.867461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc06e4-390c-4eb6-ad7d-81ac9d38acaf None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:22.867744 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc06e4-390c-4eb6-ad7d-81ac9d38acaf None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:22.868020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc06e4-390c-4eb6-ad7d-81ac9d38acaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:22.876760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc06e4-390c-4eb6-ad7d-81ac9d38acaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:22.878205 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc06e4-390c-4eb6-ad7d-81ac9d38acaf None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-5cbc06e4-390c-4eb6-ad7d-81ac9d38acaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:54:22.892336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:22.893287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:22.895052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:22.895052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:22.895052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:54:22.895052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:54:22.895052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:54:22.895052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:54:22.895052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:54:22.895052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:54:22.895052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 11:54:22.895052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:22.895052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 542/1091] 10.222.0.58 () {56 vars in 1093 bytes} [Tue May 17 11:54:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:22.899370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35468490-9988-4e5b-8116-af483a9a3aa2 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:23.001596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35468490-9988-4e5b-8116-af483a9a3aa2 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:23.036716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826b093-0e54-4121-aa02-d3a153eef59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:23.037550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826b093-0e54-4121-aa02-d3a153eef59a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:23.037911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826b093-0e54-4121-aa02-d3a153eef59a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:23.038247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826b093-0e54-4121-aa02-d3a153eef59a None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:23.039370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826b093-0e54-4121-aa02-d3a153eef59a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:23.039813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826b093-0e54-4121-aa02-d3a153eef59a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:23.041274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826b093-0e54-4121-aa02-d3a153eef59a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:23.058772 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 550/1092] 10.222.0.58 () {56 vars in 1133 bytes} [Tue May 17 11:54:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:23.065995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc06e4-390c-4eb6-ad7d-81ac9d38acaf None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:23.169452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc06e4-390c-4eb6-ad7d-81ac9d38acaf None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:23.204043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1225-b115-4b90-9c3a-3a34c6a47b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:23.204730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1225-b115-4b90-9c3a-3a34c6a47b27 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:23.205014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1225-b115-4b90-9c3a-3a34c6a47b27 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:23.205286 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1225-b115-4b90-9c3a-3a34c6a47b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:23.273363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da1225-b115-4b90-9c3a-3a34c6a47b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:23.274741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da1225-b115-4b90-9c3a-3a34c6a47b27 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:23.374704 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 543/1093] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:54:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:54:23.380399 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826b093-0e54-4121-aa02-d3a153eef59a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:23.474596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826b093-0e54-4121-aa02-d3a153eef59a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:23.506304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e49a8-ed5d-4667-bc56-1d60a34cf74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:23.507087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e49a8-ed5d-4667-bc56-1d60a34cf74e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:23.507367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e49a8-ed5d-4667-bc56-1d60a34cf74e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:23.507638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e49a8-ed5d-4667-bc56-1d60a34cf74e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:23.517826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e49a8-ed5d-4667-bc56-1d60a34cf74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:23.519259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e49a8-ed5d-4667-bc56-1d60a34cf74e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-a24e49a8-ed5d-4667-bc56-1d60a34cf74e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:54:23.537082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:23.538129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:23.539070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:54:23.539070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:54:23.539070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:54:23.539070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:23.539070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 551/1094] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:23.543876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1225-b115-4b90-9c3a-3a34c6a47b27 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:23.643561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1225-b115-4b90-9c3a-3a34c6a47b27 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:23.675783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb81d9-4a46-41e1-81d4-6541b4981d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:23.676459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb81d9-4a46-41e1-81d4-6541b4981d37 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:23.676744 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb81d9-4a46-41e1-81d4-6541b4981d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:23.677013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb81d9-4a46-41e1-81d4-6541b4981d37 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:23.677728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb81d9-4a46-41e1-81d4-6541b4981d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:23.678034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb81d9-4a46-41e1-81d4-6541b4981d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:23.679387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb81d9-4a46-41e1-81d4-6541b4981d37 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:23.690933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 544/1095] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:23.696573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e49a8-ed5d-4667-bc56-1d60a34cf74e None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:23.770795 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd0f60-1cde-4072-ad18-f69b9fe15bd2 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:23.771079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd0f60-1cde-4072-ad18-f69b9fe15bd2 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:23.771357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd0f60-1cde-4072-ad18-f69b9fe15bd2 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:23.772759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 545/1096] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:23.777868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f6152-111b-45de-9f44-cb21d9ed9a21 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:23.778091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f6152-111b-45de-9f44-cb21d9ed9a21 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:23.778364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f6152-111b-45de-9f44-cb21d9ed9a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:23.794484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-890f6152-111b-45de-9f44-cb21d9ed9a21 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:23.795161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e49a8-ed5d-4667-bc56-1d60a34cf74e None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:23.795817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-890f6152-111b-45de-9f44-cb21d9ed9a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:23.829081 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718de4a0-ad21-4f05-a890-3b9bc4eecb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:23.829874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718de4a0-ad21-4f05-a890-3b9bc4eecb85 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:23.830154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718de4a0-ad21-4f05-a890-3b9bc4eecb85 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:23.830428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718de4a0-ad21-4f05-a890-3b9bc4eecb85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:23.836993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718de4a0-ad21-4f05-a890-3b9bc4eecb85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:23.838431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718de4a0-ad21-4f05-a890-3b9bc4eecb85 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-718de4a0-ad21-4f05-a890-3b9bc4eecb85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:54:23.851890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:23.852838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:23.853720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:54:23.853720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:54:23.853720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:54:23.853720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:54:23.853720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:54:23.853720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:54:23.853720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:54:23.853720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:23.853720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 552/1097] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:54:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:54:23.858967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718de4a0-ad21-4f05-a890-3b9bc4eecb85 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:23.860009 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 546/1098] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:54:23.882786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f6152-111b-45de-9f44-cb21d9ed9a21 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:23.954402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718de4a0-ad21-4f05-a890-3b9bc4eecb85 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:23.974534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f6152-111b-45de-9f44-cb21d9ed9a21 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:23.986422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0015194-7148-4e30-be8d-d4214d6618f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:23.987081 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015194-7148-4e30-be8d-d4214d6618f0 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:23.987368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015194-7148-4e30-be8d-d4214d6618f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:23.987645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0015194-7148-4e30-be8d-d4214d6618f0 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:23.988464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0015194-7148-4e30-be8d-d4214d6618f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:23.988778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0015194-7148-4e30-be8d-d4214d6618f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:23.990210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0015194-7148-4e30-be8d-d4214d6618f0 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:24.002756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 553/1099] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:54:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:24.007259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d55d2-15ca-43da-94a9-e8efe90fbd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:24.008038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d55d2-15ca-43da-94a9-e8efe90fbd83 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:24.008346 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d55d2-15ca-43da-94a9-e8efe90fbd83 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:24.008620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d55d2-15ca-43da-94a9-e8efe90fbd83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:24.008809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0015194-7148-4e30-be8d-d4214d6618f0 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:24.018878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d55d2-15ca-43da-94a9-e8efe90fbd83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-935d55d2-15ca-43da-94a9-e8efe90fbd83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:54:24.026572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:24.027475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:24.028386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 547/1100] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:54:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:54:24.033525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d55d2-15ca-43da-94a9-e8efe90fbd83 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:24.102464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0015194-7148-4e30-be8d-d4214d6618f0 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:24.128083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d55d2-15ca-43da-94a9-e8efe90fbd83 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:24.138278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcd05d-6404-4e90-ad60-f50415ef16a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:24.139019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcd05d-6404-4e90-ad60-f50415ef16a2 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:24.139325 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcd05d-6404-4e90-ad60-f50415ef16a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:24.139557 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcd05d-6404-4e90-ad60-f50415ef16a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:24.140428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcd05d-6404-4e90-ad60-f50415ef16a2 None admin] RBAC: Adding query filter params (role.id=06c32961ffa44ca7ab91a257468ae7d4, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=d86479ff40f54e7793f1771cb6ad362a) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:24.140738 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcd05d-6404-4e90-ad60-f50415ef16a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:24.142948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcd05d-6404-4e90-ad60-f50415ef16a2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:24.148080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 554/1101] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:54:24 2022] GET /identity/v3/role_assignments?user.id=d86479ff40f54e7793f1771cb6ad362a&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=06c32961ffa44ca7ab91a257468ae7d4 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:24.164019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f7bb0-4b09-466f-8e5f-0daaf07c94fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:24.164736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f7bb0-4b09-466f-8e5f-0daaf07c94fe None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:24.165014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f7bb0-4b09-466f-8e5f-0daaf07c94fe None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:24.165285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f7bb0-4b09-466f-8e5f-0daaf07c94fe None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:24.166054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f7bb0-4b09-466f-8e5f-0daaf07c94fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:24.166359 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f7bb0-4b09-466f-8e5f-0daaf07c94fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:24.167769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f7bb0-4b09-466f-8e5f-0daaf07c94fe None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:24.177474 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 548/1102] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:54:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:24.183361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcd05d-6404-4e90-ad60-f50415ef16a2 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:24.284296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcd05d-6404-4e90-ad60-f50415ef16a2 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:24.318906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382842d-6f0a-4e23-81a4-1ad77f246f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:24.319775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382842d-6f0a-4e23-81a4-1ad77f246f04 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:24.320051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382842d-6f0a-4e23-81a4-1ad77f246f04 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:24.320353 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382842d-6f0a-4e23-81a4-1ad77f246f04 None admin] PATH_INFO: `/v3/users/cba5da2de2f644058af448be2eac2e4d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:24.321548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382842d-6f0a-4e23-81a4-1ad77f246f04 None admin] RBAC: Authorizing `identity:get_user(user_id=cba5da2de2f644058af448be2eac2e4d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:24.322974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382842d-6f0a-4e23-81a4-1ad77f246f04 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:24.324788 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 555/1103] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:24 2022] GET /identity/v3/users/cba5da2de2f644058af448be2eac2e4d => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:24.331037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f7bb0-4b09-466f-8e5f-0daaf07c94fe None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:24.428709 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f7bb0-4b09-466f-8e5f-0daaf07c94fe None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:24.462200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870a446-22ea-4f2c-adb4-4bb9a45bdaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:24.462849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870a446-22ea-4f2c-adb4-4bb9a45bdaa8 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:24.463123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870a446-22ea-4f2c-adb4-4bb9a45bdaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:24.463399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870a446-22ea-4f2c-adb4-4bb9a45bdaa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:24.535012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870a446-22ea-4f2c-adb4-4bb9a45bdaa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:24.536444 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870a446-22ea-4f2c-adb4-4bb9a45bdaa8 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:24.632838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 549/1104] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:54:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 11:54:24.639024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382842d-6f0a-4e23-81a4-1ad77f246f04 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:24.739200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382842d-6f0a-4e23-81a4-1ad77f246f04 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:24.772441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61e914-ce83-4bd1-a158-8b319aa088d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:24.773307 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61e914-ce83-4bd1-a158-8b319aa088d5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:24.773584 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61e914-ce83-4bd1-a158-8b319aa088d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:24.773861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61e914-ce83-4bd1-a158-8b319aa088d5 None admin] PATH_INFO: `/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:24.775036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61e914-ce83-4bd1-a158-8b319aa088d5 None admin] RBAC: Authorizing `identity:get_project(project_id=5155a8e962544cb49ec347cbaf5dcd4d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:24.776504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61e914-ce83-4bd1-a158-8b319aa088d5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:24.778183 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 556/1105] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:54:24 2022] GET /identity/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:24.785520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870a446-22ea-4f2c-adb4-4bb9a45bdaa8 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:24.882419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870a446-22ea-4f2c-adb4-4bb9a45bdaa8 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:24.915660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93476fc9-3237-4778-96dc-7fea1da8a667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:24.916346 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93476fc9-3237-4778-96dc-7fea1da8a667 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:24.916626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93476fc9-3237-4778-96dc-7fea1da8a667 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:24.916895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93476fc9-3237-4778-96dc-7fea1da8a667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:24.917719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93476fc9-3237-4778-96dc-7fea1da8a667 None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=5155a8e962544cb49ec347cbaf5dcd4d, user.id=cba5da2de2f644058af448be2eac2e4d) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:24.918026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93476fc9-3237-4778-96dc-7fea1da8a667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:24.919474 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93476fc9-3237-4778-96dc-7fea1da8a667 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:24.925910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 550/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:54:24 2022] GET /identity/v3/role_assignments?user.id=cba5da2de2f644058af448be2eac2e4d&scope.project.id=5155a8e962544cb49ec347cbaf5dcd4d&role.id=3db33dfd3d6544fd81933007633fc56a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:27.144944 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf967-6fe4-4350-b2d0-902408340f45 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:27.145513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf967-6fe4-4350-b2d0-902408340f45 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:27.145513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cf967-6fe4-4350-b2d0-902408340f45 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:27.146888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 557/1107] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:27.152283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91a1d-a3ec-44f7-b841-ab04f534756c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:27.152687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91a1d-a3ec-44f7-b841-ab04f534756c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:27.152862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91a1d-a3ec-44f7-b841-ab04f534756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:27.169144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e9e91a1d-a3ec-44f7-b841-ab04f534756c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:27.171171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e9e91a1d-a3ec-44f7-b841-ab04f534756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:27.233755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 551/1108] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:27.258105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cf967-6fe4-4350-b2d0-902408340f45 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:27.353895 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cf967-6fe4-4350-b2d0-902408340f45 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:27.385533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a60e8-0252-40ab-8e3a-3629cb1910c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:27.386301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a60e8-0252-40ab-8e3a-3629cb1910c6 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:27.386580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a60e8-0252-40ab-8e3a-3629cb1910c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:27.386850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a60e8-0252-40ab-8e3a-3629cb1910c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:27.388000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a60e8-0252-40ab-8e3a-3629cb1910c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:27.390219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a60e8-0252-40ab-8e3a-3629cb1910c6 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:27.391795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 558/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:27.397338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e91a1d-a3ec-44f7-b841-ab04f534756c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:27.488415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e91a1d-a3ec-44f7-b841-ab04f534756c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:27.520437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3261be8-4c68-4ad1-805e-64e425b6116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:27.521086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261be8-4c68-4ad1-805e-64e425b6116d None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:27.521363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261be8-4c68-4ad1-805e-64e425b6116d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:27.521635 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261be8-4c68-4ad1-805e-64e425b6116d None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:27.522331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3261be8-4c68-4ad1-805e-64e425b6116d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:27.523755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3261be8-4c68-4ad1-805e-64e425b6116d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:27.543291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 552/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:54:27 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:54:29.769610 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c18d-e489-4bf8-8fc2-a0dd52fd5f03 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:29.770159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c18d-e489-4bf8-8fc2-a0dd52fd5f03 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:29.770159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c18d-e489-4bf8-8fc2-a0dd52fd5f03 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:29.771521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 559/1111] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:29.776718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64d98-389c-4ac7-b6df-7f300ab807e9 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:29.777105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64d98-389c-4ac7-b6df-7f300ab807e9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:29.777206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b64d98-389c-4ac7-b6df-7f300ab807e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:29.793887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-43b64d98-389c-4ac7-b6df-7f300ab807e9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:29.795654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-43b64d98-389c-4ac7-b6df-7f300ab807e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:29.858413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 553/1112] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:29.881436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153c18d-e489-4bf8-8fc2-a0dd52fd5f03 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:29.976660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153c18d-e489-4bf8-8fc2-a0dd52fd5f03 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:30.007813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ef3e-7a43-4cd9-90d7-64cbca61d295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:30.008680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ef3e-7a43-4cd9-90d7-64cbca61d295 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:30.008961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ef3e-7a43-4cd9-90d7-64cbca61d295 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:30.009235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2ef3e-7a43-4cd9-90d7-64cbca61d295 None admin] PATH_INFO: `/v3/roles/297b3b3e5982438e9af6c05761718fcc` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:30.010668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2ef3e-7a43-4cd9-90d7-64cbca61d295 None admin] RBAC: Authorizing `identity:get_role(role_id=297b3b3e5982438e9af6c05761718fcc)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:30.012030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2ef3e-7a43-4cd9-90d7-64cbca61d295 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:30.013917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 560/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:29 2022] GET /identity/v3/roles/297b3b3e5982438e9af6c05761718fcc => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:30.019861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b64d98-389c-4ac7-b6df-7f300ab807e9 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:30.111145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b64d98-389c-4ac7-b6df-7f300ab807e9 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:30.142602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567645-8b63-4645-b51b-e8d7bbe31f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:30.143446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567645-8b63-4645-b51b-e8d7bbe31f49 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:30.143728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567645-8b63-4645-b51b-e8d7bbe31f49 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:30.144003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567645-8b63-4645-b51b-e8d7bbe31f49 None admin] PATH_INFO: `/v3/users/db6579f98f18429db4f6fd26e5e493ef` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:30.156449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28567645-8b63-4645-b51b-e8d7bbe31f49 None admin] RBAC: Authorizing `identity:get_user(user_id=db6579f98f18429db4f6fd26e5e493ef)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:30.157881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28567645-8b63-4645-b51b-e8d7bbe31f49 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:30.159478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 554/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:30 2022] GET /identity/v3/users/db6579f98f18429db4f6fd26e5e493ef => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:30.165144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ef3e-7a43-4cd9-90d7-64cbca61d295 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:30.257845 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2ef3e-7a43-4cd9-90d7-64cbca61d295 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:30.289089 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e99d50-418c-400e-a71e-19506fab9323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:30.289716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e99d50-418c-400e-a71e-19506fab9323 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:30.289994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e99d50-418c-400e-a71e-19506fab9323 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:30.290268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e99d50-418c-400e-a71e-19506fab9323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:30.352516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e99d50-418c-400e-a71e-19506fab9323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:30.353950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e99d50-418c-400e-a71e-19506fab9323 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:30.444809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 561/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:54:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:54:30.450601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567645-8b63-4645-b51b-e8d7bbe31f49 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:30.547929 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567645-8b63-4645-b51b-e8d7bbe31f49 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:30.579665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef42a0-c255-4bea-a10b-1ad617b1caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:30.580532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef42a0-c255-4bea-a10b-1ad617b1caec None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:30.580811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef42a0-c255-4bea-a10b-1ad617b1caec None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:30.581081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef42a0-c255-4bea-a10b-1ad617b1caec None admin] PATH_INFO: `/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:30.582239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef42a0-c255-4bea-a10b-1ad617b1caec None admin] RBAC: Authorizing `identity:get_project(project_id=5155a8e962544cb49ec347cbaf5dcd4d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:30.583652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef42a0-c255-4bea-a10b-1ad617b1caec None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:30.585338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 555/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:54:30 2022] GET /identity/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:30.591335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e99d50-418c-400e-a71e-19506fab9323 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:30.683296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e99d50-418c-400e-a71e-19506fab9323 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:30.715077 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ba6fc-9c57-404f-a29a-2c20fd91508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:30.715647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ba6fc-9c57-404f-a29a-2c20fd91508b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:30.715923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ba6fc-9c57-404f-a29a-2c20fd91508b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:30.716213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ba6fc-9c57-404f-a29a-2c20fd91508b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:30.717820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ba6fc-9c57-404f-a29a-2c20fd91508b None admin] RBAC: Adding query filter params (role.id=297b3b3e5982438e9af6c05761718fcc, scope.project.id=5155a8e962544cb49ec347cbaf5dcd4d, user.id=db6579f98f18429db4f6fd26e5e493ef) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:30.718129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ba6fc-9c57-404f-a29a-2c20fd91508b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:30.719554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ba6fc-9c57-404f-a29a-2c20fd91508b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:30.724672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 562/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:54:30 2022] GET /identity/v3/role_assignments?user.id=db6579f98f18429db4f6fd26e5e493ef&scope.project.id=5155a8e962544cb49ec347cbaf5dcd4d&role.id=297b3b3e5982438e9af6c05761718fcc => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:32.901964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7798e-e208-40dd-8e20-cceeebbe5a40 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:32.902494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7798e-e208-40dd-8e20-cceeebbe5a40 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:32.902494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7798e-e208-40dd-8e20-cceeebbe5a40 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:32.903858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 556/1118] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:32.908992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b0b6-34b8-499e-acd4-b82d0ff31510 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:32.909428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b0b6-34b8-499e-acd4-b82d0ff31510 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:32.909526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b0b6-34b8-499e-acd4-b82d0ff31510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:32.926258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7c01b0b6-34b8-499e-acd4-b82d0ff31510 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:32.927409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7c01b0b6-34b8-499e-acd4-b82d0ff31510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:32.989993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 563/1119] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:33.012839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7798e-e208-40dd-8e20-cceeebbe5a40 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:33.109628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7798e-e208-40dd-8e20-cceeebbe5a40 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:33.141366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00617975-671b-4df1-8c1b-3534390b2294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:33.142195 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00617975-671b-4df1-8c1b-3534390b2294 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:33.142476 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00617975-671b-4df1-8c1b-3534390b2294 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:33.142749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00617975-671b-4df1-8c1b-3534390b2294 None admin] PATH_INFO: `/v3/roles/297b3b3e5982438e9af6c05761718fcc` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:33.144216 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00617975-671b-4df1-8c1b-3534390b2294 None admin] RBAC: Authorizing `identity:get_role(role_id=297b3b3e5982438e9af6c05761718fcc)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:33.145577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00617975-671b-4df1-8c1b-3534390b2294 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:33.146905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 557/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:33 2022] GET /identity/v3/roles/297b3b3e5982438e9af6c05761718fcc => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:33.152882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01b0b6-34b8-499e-acd4-b82d0ff31510 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:33.244498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01b0b6-34b8-499e-acd4-b82d0ff31510 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:33.275832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b877d0-7e91-4be9-bf2b-8c4f21685773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:33.276703 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b877d0-7e91-4be9-bf2b-8c4f21685773 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:33.276982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b877d0-7e91-4be9-bf2b-8c4f21685773 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:33.277252 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b877d0-7e91-4be9-bf2b-8c4f21685773 None admin] PATH_INFO: `/v3/users/db6579f98f18429db4f6fd26e5e493ef` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:33.278405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b877d0-7e91-4be9-bf2b-8c4f21685773 None admin] RBAC: Authorizing `identity:get_user(user_id=db6579f98f18429db4f6fd26e5e493ef)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:33.280522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b877d0-7e91-4be9-bf2b-8c4f21685773 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:33.282105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 564/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:33 2022] GET /identity/v3/users/db6579f98f18429db4f6fd26e5e493ef => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:33.287767 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00617975-671b-4df1-8c1b-3534390b2294 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:33.381583 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00617975-671b-4df1-8c1b-3534390b2294 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:33.412900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b5606-4144-405d-88fc-4a05d6b1eed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:33.413684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b5606-4144-405d-88fc-4a05d6b1eed5 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:33.413993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b5606-4144-405d-88fc-4a05d6b1eed5 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:33.414270 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b5606-4144-405d-88fc-4a05d6b1eed5 None admin] PATH_INFO: `/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:33.415428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b5606-4144-405d-88fc-4a05d6b1eed5 None admin] RBAC: Authorizing `identity:get_project(project_id=5155a8e962544cb49ec347cbaf5dcd4d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:33.417053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b5606-4144-405d-88fc-4a05d6b1eed5 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:33.418699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 558/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:54:33 2022] GET /identity/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:33.424888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b877d0-7e91-4be9-bf2b-8c4f21685773 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:33.517512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b877d0-7e91-4be9-bf2b-8c4f21685773 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:33.550340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f27095-cd44-4a34-9121-d056251b985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:33.551215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27095-cd44-4a34-9121-d056251b985a None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:33.551494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27095-cd44-4a34-9121-d056251b985a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:33.551762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27095-cd44-4a34-9121-d056251b985a None admin] PATH_INFO: `/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d/users/db6579f98f18429db4f6fd26e5e493ef/roles/297b3b3e5982438e9af6c05761718fcc` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:33.553925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f27095-cd44-4a34-9121-d056251b985a None admin] RBAC: Authorizing `identity:create_grant(project_id=5155a8e962544cb49ec347cbaf5dcd4d, user_id=db6579f98f18429db4f6fd26e5e493ef, role_id=297b3b3e5982438e9af6c05761718fcc)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:33.555335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f27095-cd44-4a34-9121-d056251b985a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:33.567777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 565/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:54:33 2022] PUT /identity/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d/users/db6579f98f18429db4f6fd26e5e493ef/roles/297b3b3e5982438e9af6c05761718fcc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:54:35.825303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560ed9-0375-41a3-a101-d6a7a8490d16 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:35.825936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560ed9-0375-41a3-a101-d6a7a8490d16 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:35.825936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88560ed9-0375-41a3-a101-d6a7a8490d16 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:35.827669 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 559/1124] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:35.833043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9c50-ccd0-48ea-aa87-715dd5d49af6 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:35.833455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9c50-ccd0-48ea-aa87-715dd5d49af6 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:35.833600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9c50-ccd0-48ea-aa87-715dd5d49af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:35.849938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-19aa9c50-ccd0-48ea-aa87-715dd5d49af6 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:35.851105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-19aa9c50-ccd0-48ea-aa87-715dd5d49af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:35.913363 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 566/1125] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:35.937783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560ed9-0375-41a3-a101-d6a7a8490d16 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:36.033432 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88560ed9-0375-41a3-a101-d6a7a8490d16 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:36.066052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48de521-4326-4cfc-a4af-0b7304ae208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:36.066884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48de521-4326-4cfc-a4af-0b7304ae208c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:36.067166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48de521-4326-4cfc-a4af-0b7304ae208c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:36.067440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48de521-4326-4cfc-a4af-0b7304ae208c None admin] PATH_INFO: `/v3/roles/297b3b3e5982438e9af6c05761718fcc` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:36.068914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48de521-4326-4cfc-a4af-0b7304ae208c None admin] RBAC: Authorizing `identity:get_role(role_id=297b3b3e5982438e9af6c05761718fcc)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:36.070289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48de521-4326-4cfc-a4af-0b7304ae208c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:36.071630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 560/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:35 2022] GET /identity/v3/roles/297b3b3e5982438e9af6c05761718fcc => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:36.077573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa9c50-ccd0-48ea-aa87-715dd5d49af6 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:36.170020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa9c50-ccd0-48ea-aa87-715dd5d49af6 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:36.202108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f9e3f-058e-493d-bf50-41a074cafd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:36.202954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f9e3f-058e-493d-bf50-41a074cafd85 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:36.203233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f9e3f-058e-493d-bf50-41a074cafd85 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:36.203502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f9e3f-058e-493d-bf50-41a074cafd85 None admin] PATH_INFO: `/v3/users/db6579f98f18429db4f6fd26e5e493ef` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:36.204687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f9e3f-058e-493d-bf50-41a074cafd85 None admin] RBAC: Authorizing `identity:get_user(user_id=db6579f98f18429db4f6fd26e5e493ef)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:36.206125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f9e3f-058e-493d-bf50-41a074cafd85 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:36.207716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 567/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:36 2022] GET /identity/v3/users/db6579f98f18429db4f6fd26e5e493ef => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:36.213191 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48de521-4326-4cfc-a4af-0b7304ae208c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:36.306712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48de521-4326-4cfc-a4af-0b7304ae208c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:36.338282 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d25ce-3d0c-48e4-9311-41b732c45f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:36.338853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d25ce-3d0c-48e4-9311-41b732c45f1a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:36.339136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d25ce-3d0c-48e4-9311-41b732c45f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:36.339410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d25ce-3d0c-48e4-9311-41b732c45f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:36.401818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d25ce-3d0c-48e4-9311-41b732c45f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:36.403241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d25ce-3d0c-48e4-9311-41b732c45f1a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:36.495273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 561/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:54:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 11:54:36.501546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f9e3f-058e-493d-bf50-41a074cafd85 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:36.595717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f9e3f-058e-493d-bf50-41a074cafd85 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:36.627475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061da297-0b17-479e-ad5a-2bf29604fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:36.628349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061da297-0b17-479e-ad5a-2bf29604fcb4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:36.628632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061da297-0b17-479e-ad5a-2bf29604fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:36.628906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061da297-0b17-479e-ad5a-2bf29604fcb4 None admin] PATH_INFO: `/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:36.630073 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061da297-0b17-479e-ad5a-2bf29604fcb4 None admin] RBAC: Authorizing `identity:get_project(project_id=5155a8e962544cb49ec347cbaf5dcd4d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:36.631508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061da297-0b17-479e-ad5a-2bf29604fcb4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:36.633510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 568/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:54:36 2022] GET /identity/v3/projects/5155a8e962544cb49ec347cbaf5dcd4d => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:36.640317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d25ce-3d0c-48e4-9311-41b732c45f1a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:36.732730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d25ce-3d0c-48e4-9311-41b732c45f1a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:36.764687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ae12b-92ee-4d3d-b52e-8554f9286317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:36.765329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ae12b-92ee-4d3d-b52e-8554f9286317 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:36.765611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ae12b-92ee-4d3d-b52e-8554f9286317 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:36.767510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ae12b-92ee-4d3d-b52e-8554f9286317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:36.767510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ae12b-92ee-4d3d-b52e-8554f9286317 None admin] RBAC: Adding query filter params (role.id=297b3b3e5982438e9af6c05761718fcc, scope.project.id=5155a8e962544cb49ec347cbaf5dcd4d, user.id=db6579f98f18429db4f6fd26e5e493ef) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:36.767510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ae12b-92ee-4d3d-b52e-8554f9286317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:36.768430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ae12b-92ee-4d3d-b52e-8554f9286317 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:36.774098 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 562/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:54:36 2022] GET /identity/v3/role_assignments?user.id=db6579f98f18429db4f6fd26e5e493ef&scope.project.id=5155a8e962544cb49ec347cbaf5dcd4d&role.id=297b3b3e5982438e9af6c05761718fcc => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:38.976498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8304b7b-46e6-4146-8628-2686e7257d1b None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:38.977019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8304b7b-46e6-4146-8628-2686e7257d1b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:38.977019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8304b7b-46e6-4146-8628-2686e7257d1b None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:38.978404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 569/1131] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:38.984002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7c76-da28-4f91-af05-0db02dbc6ff2 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:38.984420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7c76-da28-4f91-af05-0db02dbc6ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:38.984582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7c76-da28-4f91-af05-0db02dbc6ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:39.001193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4c1e7c76-da28-4f91-af05-0db02dbc6ff2 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:39.002344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4c1e7c76-da28-4f91-af05-0db02dbc6ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:39.063949 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 563/1132] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:54:39.086953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8304b7b-46e6-4146-8628-2686e7257d1b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:39.181530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8304b7b-46e6-4146-8628-2686e7257d1b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:39.213789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98647c6-3e73-49f4-87ef-4a6c6b247c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:39.214558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98647c6-3e73-49f4-87ef-4a6c6b247c35 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:39.214834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98647c6-3e73-49f4-87ef-4a6c6b247c35 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:39.215103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98647c6-3e73-49f4-87ef-4a6c6b247c35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:39.216270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98647c6-3e73-49f4-87ef-4a6c6b247c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:39.217814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98647c6-3e73-49f4-87ef-4a6c6b247c35 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:39.219383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 570/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:39.225179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7c76-da28-4f91-af05-0db02dbc6ff2 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:39.319822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7c76-da28-4f91-af05-0db02dbc6ff2 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:39.352538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1703f6c-d1aa-4383-a5af-d8be50735374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:39.353179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1703f6c-d1aa-4383-a5af-d8be50735374 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:39.353464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1703f6c-d1aa-4383-a5af-d8be50735374 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:39.353742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1703f6c-d1aa-4383-a5af-d8be50735374 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:39.354439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1703f6c-d1aa-4383-a5af-d8be50735374 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:39.355900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1703f6c-d1aa-4383-a5af-d8be50735374 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:39.380860 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 564/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:54:39 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:54:41.652458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536880d7-7860-4231-8f22-65b344cf9dfc None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:41.652968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536880d7-7860-4231-8f22-65b344cf9dfc None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:41.653061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536880d7-7860-4231-8f22-65b344cf9dfc None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:41.655031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 571/1135] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:41.660136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dcce0-ea06-438e-bc81-f8bff6aecc35 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:41.660575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dcce0-ea06-438e-bc81-f8bff6aecc35 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:41.660714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dcce0-ea06-438e-bc81-f8bff6aecc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:41.677456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-602dcce0-ea06-438e-bc81-f8bff6aecc35 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:41.678604 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-602dcce0-ea06-438e-bc81-f8bff6aecc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:41.740684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 565/1136] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:41.764192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536880d7-7860-4231-8f22-65b344cf9dfc None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:41.859698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536880d7-7860-4231-8f22-65b344cf9dfc None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:41.891233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17ce9-32b0-43b5-bba9-c0c03897dab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:41.892010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17ce9-32b0-43b5-bba9-c0c03897dab2 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:41.892320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17ce9-32b0-43b5-bba9-c0c03897dab2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:41.892593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17ce9-32b0-43b5-bba9-c0c03897dab2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:41.893734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca17ce9-32b0-43b5-bba9-c0c03897dab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:41.895186 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca17ce9-32b0-43b5-bba9-c0c03897dab2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:41.896811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 572/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:54:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:41.902496 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dcce0-ea06-438e-bc81-f8bff6aecc35 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:41.995268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dcce0-ea06-438e-bc81-f8bff6aecc35 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:42.027843 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9906918-d647-4695-b968-4d798c491198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:42.028538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9906918-d647-4695-b968-4d798c491198 None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:42.029432 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9906918-d647-4695-b968-4d798c491198 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:42.029720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9906918-d647-4695-b968-4d798c491198 None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:42.030432 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9906918-d647-4695-b968-4d798c491198 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:42.031863 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9906918-d647-4695-b968-4d798c491198 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:42.050636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 566/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:54:41 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:54:44.275722 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dd305-ced0-4ed4-8b2c-beb398fe060c None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:44.276301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dd305-ced0-4ed4-8b2c-beb398fe060c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:44.276301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dd305-ced0-4ed4-8b2c-beb398fe060c None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:44.277674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 573/1139] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:44.283135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40210827-d231-441f-80d9-4a969c6a8d6c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:44.283568 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40210827-d231-441f-80d9-4a969c6a8d6c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:44.283692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40210827-d231-441f-80d9-4a969c6a8d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:44.300515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-40210827-d231-441f-80d9-4a969c6a8d6c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:44.301670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-40210827-d231-441f-80d9-4a969c6a8d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:44.364297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 567/1140] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:44.387057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dd305-ced0-4ed4-8b2c-beb398fe060c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:44.482852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dd305-ced0-4ed4-8b2c-beb398fe060c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:44.514464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f492e-5a9c-4b26-90f9-8cdade94c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:44.515235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f492e-5a9c-4b26-90f9-8cdade94c476 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:44.515514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f492e-5a9c-4b26-90f9-8cdade94c476 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:44.515786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f492e-5a9c-4b26-90f9-8cdade94c476 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:44.526933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f492e-5a9c-4b26-90f9-8cdade94c476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-175f492e-5a9c-4b26-90f9-8cdade94c476 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:54:44.535162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:44.536352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:44.537659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 574/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:54:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:44.542296 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40210827-d231-441f-80d9-4a969c6a8d6c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:44.638654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40210827-d231-441f-80d9-4a969c6a8d6c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:44.670244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c875ee0-8548-450c-aa6d-2d2e35a0b8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:44.670884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875ee0-8548-450c-aa6d-2d2e35a0b8ab None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:44.671163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875ee0-8548-450c-aa6d-2d2e35a0b8ab None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:44.671434 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875ee0-8548-450c-aa6d-2d2e35a0b8ab None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:44.672173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c875ee0-8548-450c-aa6d-2d2e35a0b8ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:44.672505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c875ee0-8548-450c-aa6d-2d2e35a0b8ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:44.673854 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c875ee0-8548-450c-aa6d-2d2e35a0b8ab None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:44.681405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 568/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:54:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:44.687418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f492e-5a9c-4b26-90f9-8cdade94c476 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:44.781028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f492e-5a9c-4b26-90f9-8cdade94c476 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:44.812667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cfe48-76c2-4b12-ac5d-c043f13a2b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:44.813524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cfe48-76c2-4b12-ac5d-c043f13a2b35 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:44.813806 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cfe48-76c2-4b12-ac5d-c043f13a2b35 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:44.814080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cfe48-76c2-4b12-ac5d-c043f13a2b35 None admin] PATH_INFO: `/v3/users/8ec8fb45b767477f83038c0c327e203b` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:44.827056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cfe48-76c2-4b12-ac5d-c043f13a2b35 None admin] RBAC: Authorizing `identity:get_user(user_id=8ec8fb45b767477f83038c0c327e203b)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:44.828522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cfe48-76c2-4b12-ac5d-c043f13a2b35 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:44.830135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 575/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:44 2022] GET /identity/v3/users/8ec8fb45b767477f83038c0c327e203b => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:44.835878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c875ee0-8548-450c-aa6d-2d2e35a0b8ab None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:44.929237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c875ee0-8548-450c-aa6d-2d2e35a0b8ab None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:44.960993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552d7e0-27bc-4c06-807f-d3e587717bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:44.961618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552d7e0-27bc-4c06-807f-d3e587717bf0 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:44.961896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552d7e0-27bc-4c06-807f-d3e587717bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:44.962165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552d7e0-27bc-4c06-807f-d3e587717bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:45.024888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552d7e0-27bc-4c06-807f-d3e587717bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:45.026337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552d7e0-27bc-4c06-807f-d3e587717bf0 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:45.117956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 569/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:54:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:54:45.123693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cfe48-76c2-4b12-ac5d-c043f13a2b35 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:45.217717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cfe48-76c2-4b12-ac5d-c043f13a2b35 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:45.248784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb50340-88f1-4363-a2d9-9a6b30c95578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:45.249620 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb50340-88f1-4363-a2d9-9a6b30c95578 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:45.249903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb50340-88f1-4363-a2d9-9a6b30c95578 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:45.250177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb50340-88f1-4363-a2d9-9a6b30c95578 None admin] PATH_INFO: `/v3/projects/6dbe6467cbd64e63b23a617701836bc7` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:45.251329 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb50340-88f1-4363-a2d9-9a6b30c95578 None admin] RBAC: Authorizing `identity:get_project(project_id=6dbe6467cbd64e63b23a617701836bc7)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:45.252793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb50340-88f1-4363-a2d9-9a6b30c95578 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:45.254441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 576/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:54:45 2022] GET /identity/v3/projects/6dbe6467cbd64e63b23a617701836bc7 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:45.260293 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552d7e0-27bc-4c06-807f-d3e587717bf0 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:45.352896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552d7e0-27bc-4c06-807f-d3e587717bf0 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:45.384730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fd622-5913-4038-a1e2-18566fe68df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:45.385306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fd622-5913-4038-a1e2-18566fe68df1 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:45.385582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fd622-5913-4038-a1e2-18566fe68df1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:45.385851 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fd622-5913-4038-a1e2-18566fe68df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:45.386658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fd622-5913-4038-a1e2-18566fe68df1 None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=6dbe6467cbd64e63b23a617701836bc7, user.id=8ec8fb45b767477f83038c0c327e203b) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:45.386965 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fd622-5913-4038-a1e2-18566fe68df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:45.389262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fd622-5913-4038-a1e2-18566fe68df1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:45.394415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 570/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:54:45 2022] GET /identity/v3/role_assignments?user.id=8ec8fb45b767477f83038c0c327e203b&scope.project.id=6dbe6467cbd64e63b23a617701836bc7&role.id=3db33dfd3d6544fd81933007633fc56a => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:47.570112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f6bab-fa65-4be2-a890-9d5ec7e33d64 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:47.570575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f6bab-fa65-4be2-a890-9d5ec7e33d64 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:47.570666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f6bab-fa65-4be2-a890-9d5ec7e33d64 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:47.572006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 577/1147] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:47.577768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2841c2-87aa-4bf3-a001-ba5be773353b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:47.578195 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2841c2-87aa-4bf3-a001-ba5be773353b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:47.578328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2841c2-87aa-4bf3-a001-ba5be773353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:47.594675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-fe2841c2-87aa-4bf3-a001-ba5be773353b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:47.595921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-fe2841c2-87aa-4bf3-a001-ba5be773353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:47.657234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 571/1148] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:47.679090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f6bab-fa65-4be2-a890-9d5ec7e33d64 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:47.775814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f6bab-fa65-4be2-a890-9d5ec7e33d64 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:47.806920 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b73422-34eb-4c2f-80eb-d91ab2d3aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:47.807627 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b73422-34eb-4c2f-80eb-d91ab2d3aabe None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:47.807903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b73422-34eb-4c2f-80eb-d91ab2d3aabe None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:47.808171 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b73422-34eb-4c2f-80eb-d91ab2d3aabe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:47.818474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b73422-34eb-4c2f-80eb-d91ab2d3aabe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-71b73422-34eb-4c2f-80eb-d91ab2d3aabe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:54:47.826778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:47.827730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:47.828585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 578/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:54:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:47.833866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2841c2-87aa-4bf3-a001-ba5be773353b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:47.926629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2841c2-87aa-4bf3-a001-ba5be773353b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:47.959130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7641d3-fee2-4d87-8928-4d00f441b1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:47.959787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7641d3-fee2-4d87-8928-4d00f441b1d7 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:47.960069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7641d3-fee2-4d87-8928-4d00f441b1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:47.960374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7641d3-fee2-4d87-8928-4d00f441b1d7 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:47.961115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7641d3-fee2-4d87-8928-4d00f441b1d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:47.961421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7641d3-fee2-4d87-8928-4d00f441b1d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:47.962771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7641d3-fee2-4d87-8928-4d00f441b1d7 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:47.970385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 572/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:54:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:47.976157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b73422-34eb-4c2f-80eb-d91ab2d3aabe None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:48.070631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b73422-34eb-4c2f-80eb-d91ab2d3aabe None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:48.101362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b552ea0-d1bf-434f-bc94-c6ec1bbb3349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:48.102212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b552ea0-d1bf-434f-bc94-c6ec1bbb3349 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:48.102494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b552ea0-d1bf-434f-bc94-c6ec1bbb3349 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:48.102767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b552ea0-d1bf-434f-bc94-c6ec1bbb3349 None admin] PATH_INFO: `/v3/users/8ec8fb45b767477f83038c0c327e203b` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:48.103931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b552ea0-d1bf-434f-bc94-c6ec1bbb3349 None admin] RBAC: Authorizing `identity:get_user(user_id=8ec8fb45b767477f83038c0c327e203b)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:48.105392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b552ea0-d1bf-434f-bc94-c6ec1bbb3349 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:48.107507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 579/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:47 2022] GET /identity/v3/users/8ec8fb45b767477f83038c0c327e203b => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:54:48.113093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7641d3-fee2-4d87-8928-4d00f441b1d7 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:48.206804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7641d3-fee2-4d87-8928-4d00f441b1d7 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:48.238272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb591b85-5624-4f1f-89e4-8e3174e95cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:48.239108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb591b85-5624-4f1f-89e4-8e3174e95cde None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:48.239389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb591b85-5624-4f1f-89e4-8e3174e95cde None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:48.239665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb591b85-5624-4f1f-89e4-8e3174e95cde None admin] PATH_INFO: `/v3/projects/6dbe6467cbd64e63b23a617701836bc7` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:48.240844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb591b85-5624-4f1f-89e4-8e3174e95cde None admin] RBAC: Authorizing `identity:get_project(project_id=6dbe6467cbd64e63b23a617701836bc7)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:48.242256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb591b85-5624-4f1f-89e4-8e3174e95cde None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:48.243896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 573/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:54:48 2022] GET /identity/v3/projects/6dbe6467cbd64e63b23a617701836bc7 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:48.250409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b552ea0-d1bf-434f-bc94-c6ec1bbb3349 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:48.343653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b552ea0-d1bf-434f-bc94-c6ec1bbb3349 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:48.374738 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1876c-c22b-40fa-8571-5f57ec8ab8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:48.375598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1876c-c22b-40fa-8571-5f57ec8ab8ff None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:48.375880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1876c-c22b-40fa-8571-5f57ec8ab8ff None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:48.376154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1876c-c22b-40fa-8571-5f57ec8ab8ff None admin] PATH_INFO: `/v3/projects/6dbe6467cbd64e63b23a617701836bc7/users/8ec8fb45b767477f83038c0c327e203b/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:48.378102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1876c-c22b-40fa-8571-5f57ec8ab8ff None admin] RBAC: Authorizing `identity:create_grant(project_id=6dbe6467cbd64e63b23a617701836bc7, user_id=8ec8fb45b767477f83038c0c327e203b, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:48.379521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1876c-c22b-40fa-8571-5f57ec8ab8ff None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:48.391953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 580/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:54:48 2022] PUT /identity/v3/projects/6dbe6467cbd64e63b23a617701836bc7/users/8ec8fb45b767477f83038c0c327e203b/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:54:50.596593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2eb9b-d543-4405-b7ed-b3077f713c78 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:50.597105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2eb9b-d543-4405-b7ed-b3077f713c78 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:50.597189 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2eb9b-d543-4405-b7ed-b3077f713c78 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:50.598503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 574/1154] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:50.603727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d222551-b155-4eb2-8741-93b7d4284734 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:50.604144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d222551-b155-4eb2-8741-93b7d4284734 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:50.604314 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d222551-b155-4eb2-8741-93b7d4284734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:50.620397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-3d222551-b155-4eb2-8741-93b7d4284734 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:50.621557 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3d222551-b155-4eb2-8741-93b7d4284734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:50.685426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 581/1155] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:50.709150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2eb9b-d543-4405-b7ed-b3077f713c78 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:50.805409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2eb9b-d543-4405-b7ed-b3077f713c78 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:50.837427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562e057-a109-4434-a40d-8b163cbf666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:50.838221 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562e057-a109-4434-a40d-8b163cbf666d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:50.838505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562e057-a109-4434-a40d-8b163cbf666d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:50.838783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562e057-a109-4434-a40d-8b163cbf666d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:50.850455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562e057-a109-4434-a40d-8b163cbf666d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-b562e057-a109-4434-a40d-8b163cbf666d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:54:50.858984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:50.860091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:54:50.861368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 575/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:50.866211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d222551-b155-4eb2-8741-93b7d4284734 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:50.957892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d222551-b155-4eb2-8741-93b7d4284734 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:50.990131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acde240-a798-4238-9caa-f01a63b45823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:50.990781 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde240-a798-4238-9caa-f01a63b45823 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:50.991059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde240-a798-4238-9caa-f01a63b45823 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:50.991328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde240-a798-4238-9caa-f01a63b45823 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:50.992053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acde240-a798-4238-9caa-f01a63b45823 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:50.992381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acde240-a798-4238-9caa-f01a63b45823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:50.993748 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acde240-a798-4238-9caa-f01a63b45823 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:51.001305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 582/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:51.007007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562e057-a109-4434-a40d-8b163cbf666d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:51.101325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562e057-a109-4434-a40d-8b163cbf666d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:51.132189 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bb7b4-30c1-4df6-9622-889a6f273d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:51.133047 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bb7b4-30c1-4df6-9622-889a6f273d1d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:51.133329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bb7b4-30c1-4df6-9622-889a6f273d1d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:51.133604 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bb7b4-30c1-4df6-9622-889a6f273d1d None admin] PATH_INFO: `/v3/users/8ec8fb45b767477f83038c0c327e203b` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:51.134771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bb7b4-30c1-4df6-9622-889a6f273d1d None admin] RBAC: Authorizing `identity:get_user(user_id=8ec8fb45b767477f83038c0c327e203b)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:51.136229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bb7b4-30c1-4df6-9622-889a6f273d1d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:51.137803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 576/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:54:51 2022] GET /identity/v3/users/8ec8fb45b767477f83038c0c327e203b => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:51.149465 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acde240-a798-4238-9caa-f01a63b45823 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:51.242248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acde240-a798-4238-9caa-f01a63b45823 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:51.273076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886afa31-1334-49b0-a6e1-639babe81173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:51.273713 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886afa31-1334-49b0-a6e1-639babe81173 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:51.273992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886afa31-1334-49b0-a6e1-639babe81173 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:51.274266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886afa31-1334-49b0-a6e1-639babe81173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:51.336817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886afa31-1334-49b0-a6e1-639babe81173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:51.338245 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886afa31-1334-49b0-a6e1-639babe81173 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:51.427548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 583/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:54:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:54:51.433366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bb7b4-30c1-4df6-9622-889a6f273d1d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:51.529011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bb7b4-30c1-4df6-9622-889a6f273d1d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:51.561679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b501e-8b0e-4670-9419-2ffaf555e84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:51.562522 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b501e-8b0e-4670-9419-2ffaf555e84a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:51.562804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b501e-8b0e-4670-9419-2ffaf555e84a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:51.563079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b501e-8b0e-4670-9419-2ffaf555e84a None admin] PATH_INFO: `/v3/projects/6dbe6467cbd64e63b23a617701836bc7` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:51.564288 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b501e-8b0e-4670-9419-2ffaf555e84a None admin] RBAC: Authorizing `identity:get_project(project_id=6dbe6467cbd64e63b23a617701836bc7)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:51.565753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b501e-8b0e-4670-9419-2ffaf555e84a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:51.567424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 577/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:54:51 2022] GET /identity/v3/projects/6dbe6467cbd64e63b23a617701836bc7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:51.573563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886afa31-1334-49b0-a6e1-639babe81173 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:51.665493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886afa31-1334-49b0-a6e1-639babe81173 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:51.698396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054861e-e1b3-4494-8e3d-208e97548f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:51.698980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054861e-e1b3-4494-8e3d-208e97548f4e None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:51.699262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054861e-e1b3-4494-8e3d-208e97548f4e None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:51.699534 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054861e-e1b3-4494-8e3d-208e97548f4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:51.700378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054861e-e1b3-4494-8e3d-208e97548f4e None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=6dbe6467cbd64e63b23a617701836bc7, user.id=8ec8fb45b767477f83038c0c327e203b) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:51.700743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054861e-e1b3-4494-8e3d-208e97548f4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:51.702159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054861e-e1b3-4494-8e3d-208e97548f4e None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:51.707664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 584/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:54:51 2022] GET /identity/v3/role_assignments?user.id=8ec8fb45b767477f83038c0c327e203b&scope.project.id=6dbe6467cbd64e63b23a617701836bc7&role.id=3db33dfd3d6544fd81933007633fc56a => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:53.911895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783d26-8980-48c1-8b59-203e1d389793 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:53.912547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783d26-8980-48c1-8b59-203e1d389793 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:53.912547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783d26-8980-48c1-8b59-203e1d389793 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:53.913799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 578/1162] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:53.918927 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd576b-f45e-4be8-bf0c-de2098e61aed None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:53.919366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd576b-f45e-4be8-bf0c-de2098e61aed None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:53.919483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd576b-f45e-4be8-bf0c-de2098e61aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:53.935620 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1dbd576b-f45e-4be8-bf0c-de2098e61aed None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:53.937157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1dbd576b-f45e-4be8-bf0c-de2098e61aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:53.999206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 585/1163] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:54:54.021560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783d26-8980-48c1-8b59-203e1d389793 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:54.116742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783d26-8980-48c1-8b59-203e1d389793 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:54.148314 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd2c08-2b91-48b5-b26d-4bc14c403317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:54.148950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd2c08-2b91-48b5-b26d-4bc14c403317 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:54.149231 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd2c08-2b91-48b5-b26d-4bc14c403317 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:54.149506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd2c08-2b91-48b5-b26d-4bc14c403317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:54.211906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd2c08-2b91-48b5-b26d-4bc14c403317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:54.213316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd2c08-2b91-48b5-b26d-4bc14c403317 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:54.305151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 579/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:54:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:54:54.311146 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd576b-f45e-4be8-bf0c-de2098e61aed None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:54.402773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd576b-f45e-4be8-bf0c-de2098e61aed None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:54.435299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6072e-021c-4660-b758-0f94c48a5ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:54.436036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6072e-021c-4660-b758-0f94c48a5ca1 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:54.436598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6072e-021c-4660-b758-0f94c48a5ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:54.436871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6072e-021c-4660-b758-0f94c48a5ca1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:54.443169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6072e-021c-4660-b758-0f94c48a5ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:54.444632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6072e-021c-4660-b758-0f94c48a5ca1 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-16d6072e-021c-4660-b758-0f94c48a5ca1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:54:54.458324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:54:54.459487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:54:54.460371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 586/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Tue May 17 11:54:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:54:54.465302 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd2c08-2b91-48b5-b26d-4bc14c403317 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:54.559099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd2c08-2b91-48b5-b26d-4bc14c403317 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:54.591696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b745e2a-3cea-401c-a7f6-a260a727a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:54.592462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745e2a-3cea-401c-a7f6-a260a727a124 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:54.592746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745e2a-3cea-401c-a7f6-a260a727a124 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:54.593022 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b745e2a-3cea-401c-a7f6-a260a727a124 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:54.593737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b745e2a-3cea-401c-a7f6-a260a727a124 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:54:54.594041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b745e2a-3cea-401c-a7f6-a260a727a124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:54.595393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b745e2a-3cea-401c-a7f6-a260a727a124 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:54.602211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 580/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Tue May 17 11:54:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:56.869412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b97a-06b7-42d2-8240-f4aac71c7b9a None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:56.869953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b97a-06b7-42d2-8240-f4aac71c7b9a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:56.869953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b97a-06b7-42d2-8240-f4aac71c7b9a None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:56.871333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 587/1167] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:56.878096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b4c77-ad6b-4364-934b-5a8962539add None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:56.878533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b4c77-ad6b-4364-934b-5a8962539add None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:56.878632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b4c77-ad6b-4364-934b-5a8962539add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:56.896285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a52b4c77-ad6b-4364-934b-5a8962539add None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:56.897442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a52b4c77-ad6b-4364-934b-5a8962539add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:56.960550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 581/1168] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:56.983487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01b97a-06b7-42d2-8240-f4aac71c7b9a None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:57.081551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01b97a-06b7-42d2-8240-f4aac71c7b9a None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:57.113925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cac35d-e745-4de3-abf3-5375d8528c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:57.114569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cac35d-e745-4de3-abf3-5375d8528c82 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:57.114852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cac35d-e745-4de3-abf3-5375d8528c82 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:57.115128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cac35d-e745-4de3-abf3-5375d8528c82 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:57.115862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cac35d-e745-4de3-abf3-5375d8528c82 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:57.117249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cac35d-e745-4de3-abf3-5375d8528c82 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:57.132235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 588/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Tue May 17 11:54:56 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:54:59.361324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18e4a-75a2-40d9-84bd-3ff6f2c31041 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:59.361871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18e4a-75a2-40d9-84bd-3ff6f2c31041 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:59.361871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18e4a-75a2-40d9-84bd-3ff6f2c31041 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:59.363226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 582/1170] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:54:59.368433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f618388-8d0d-48cf-8365-3b5c858a36d6 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:59.368818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f618388-8d0d-48cf-8365-3b5c858a36d6 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:59.369002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f618388-8d0d-48cf-8365-3b5c858a36d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:59.386378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-9f618388-8d0d-48cf-8365-3b5c858a36d6 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:54:59.387546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9f618388-8d0d-48cf-8365-3b5c858a36d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:54:59.452802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 589/1171] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:54:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:54:59.476083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd18e4a-75a2-40d9-84bd-3ff6f2c31041 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:59.580512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd18e4a-75a2-40d9-84bd-3ff6f2c31041 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:59.611733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb77070-8c10-4025-b7d9-0b69394559c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:59.612536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb77070-8c10-4025-b7d9-0b69394559c5 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:59.612815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb77070-8c10-4025-b7d9-0b69394559c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:59.613086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb77070-8c10-4025-b7d9-0b69394559c5 None admin] PATH_INFO: `/v3/domains/ca79cdea765b490196e995d145ab436f` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:59.623763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb77070-8c10-4025-b7d9-0b69394559c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ca79cdea765b490196e995d145ab436f)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:59.625209 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb77070-8c10-4025-b7d9-0b69394559c5 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:59.626798 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 583/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Tue May 17 11:54:59 2022] GET /identity/v3/domains/ca79cdea765b490196e995d145ab436f => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:54:59.632639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f618388-8d0d-48cf-8365-3b5c858a36d6 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:54:59.728100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f618388-8d0d-48cf-8365-3b5c858a36d6 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:54:59.760721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df22a1-e605-403f-a5da-500ff8480ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:54:59.761364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df22a1-e605-403f-a5da-500ff8480ed9 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:54:59.761649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df22a1-e605-403f-a5da-500ff8480ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:54:59.761924 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df22a1-e605-403f-a5da-500ff8480ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:54:59.762626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df22a1-e605-403f-a5da-500ff8480ed9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:54:59.765107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df22a1-e605-403f-a5da-500ff8480ed9 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:54:59.789267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 590/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:54:59 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 11:55:02.046395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0cf5-66ba-4fd5-a410-5fc49f1a535c None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:02.046970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0cf5-66ba-4fd5-a410-5fc49f1a535c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:02.046970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0cf5-66ba-4fd5-a410-5fc49f1a535c None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:02.048327 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 584/1174] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:55:02.053595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ef48c-aefb-4797-8fbc-720240f0456e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:02.054010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ef48c-aefb-4797-8fbc-720240f0456e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:02.054152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ef48c-aefb-4797-8fbc-720240f0456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:02.071507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-af8ef48c-aefb-4797-8fbc-720240f0456e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:55:02.072842 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-af8ef48c-aefb-4797-8fbc-720240f0456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:55:02.135342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 591/1175] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:55:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:55:02.162171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b0cf5-66ba-4fd5-a410-5fc49f1a535c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:02.258051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b0cf5-66ba-4fd5-a410-5fc49f1a535c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:02.290748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c271d-d9a4-45af-8009-eb94d7742774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:02.291587 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c271d-d9a4-45af-8009-eb94d7742774 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:02.291864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c271d-d9a4-45af-8009-eb94d7742774 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:02.292131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c271d-d9a4-45af-8009-eb94d7742774 None admin] PATH_INFO: `/v3/domains/ca79cdea765b490196e995d145ab436f` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:02.293305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c271d-d9a4-45af-8009-eb94d7742774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ca79cdea765b490196e995d145ab436f)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:02.295378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c271d-d9a4-45af-8009-eb94d7742774 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:02.297029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 585/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Tue May 17 11:55:02 2022] GET /identity/v3/domains/ca79cdea765b490196e995d145ab436f => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:55:02.302762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ef48c-aefb-4797-8fbc-720240f0456e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:02.396042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ef48c-aefb-4797-8fbc-720240f0456e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:02.427635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f8033-63b4-4e06-88f2-1b9f4c853a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:02.428317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8033-63b4-4e06-88f2-1b9f4c853a38 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:02.428599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8033-63b4-4e06-88f2-1b9f4c853a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:02.428869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f8033-63b4-4e06-88f2-1b9f4c853a38 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:02.429555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f8033-63b4-4e06-88f2-1b9f4c853a38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:02.430983 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f8033-63b4-4e06-88f2-1b9f4c853a38 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:02.451298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 592/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:55:02 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:55:04.697693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4e29-3b74-411d-8c61-1e4d854681a2 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:04.698229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4e29-3b74-411d-8c61-1e4d854681a2 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:04.698229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4e29-3b74-411d-8c61-1e4d854681a2 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:04.699576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 586/1178] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:55:04.705421 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8cf6b-1930-4072-90f8-dc20fdd7642f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:04.705803 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8cf6b-1930-4072-90f8-dc20fdd7642f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:04.705980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8cf6b-1930-4072-90f8-dc20fdd7642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:04.722709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-82f8cf6b-1930-4072-90f8-dc20fdd7642f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:55:04.723855 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-82f8cf6b-1930-4072-90f8-dc20fdd7642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:55:04.786808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 593/1179] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:55:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:55:04.810834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4e29-3b74-411d-8c61-1e4d854681a2 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:04.905840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4e29-3b74-411d-8c61-1e4d854681a2 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:04.936922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854802-dde0-40d4-bc51-714ba3697220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:04.937687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854802-dde0-40d4-bc51-714ba3697220 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:04.937966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854802-dde0-40d4-bc51-714ba3697220 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:04.938237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854802-dde0-40d4-bc51-714ba3697220 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:04.948064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5854802-dde0-40d4-bc51-714ba3697220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-e5854802-dde0-40d4-bc51-714ba3697220 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:55:04.956234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:55:04.957452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:55:04.958586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 587/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:55:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:55:04.963189 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8cf6b-1930-4072-90f8-dc20fdd7642f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:05.054255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8cf6b-1930-4072-90f8-dc20fdd7642f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:05.086467 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bc13a-20d4-4114-9124-4efff81aa107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:05.087120 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc13a-20d4-4114-9124-4efff81aa107 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:05.087402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc13a-20d4-4114-9124-4efff81aa107 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:05.087678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc13a-20d4-4114-9124-4efff81aa107 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:05.088444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bc13a-20d4-4114-9124-4efff81aa107 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:55:05.088754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bc13a-20d4-4114-9124-4efff81aa107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:05.090137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bc13a-20d4-4114-9124-4efff81aa107 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:05.097766 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 594/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:55:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:55:05.103542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854802-dde0-40d4-bc51-714ba3697220 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:05.196914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854802-dde0-40d4-bc51-714ba3697220 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:05.228082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4c09d-221b-4637-959e-170665df9047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:05.228952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4c09d-221b-4637-959e-170665df9047 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:05.229231 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4c09d-221b-4637-959e-170665df9047 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:05.229502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4c09d-221b-4637-959e-170665df9047 None admin] PATH_INFO: `/v3/users/4fa0fb3aaf144d3e895e0f5a59226393` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:05.242361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4c09d-221b-4637-959e-170665df9047 None admin] RBAC: Authorizing `identity:get_user(user_id=4fa0fb3aaf144d3e895e0f5a59226393)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:05.243777 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4c09d-221b-4637-959e-170665df9047 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:05.245396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 588/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:55:05 2022] GET /identity/v3/users/4fa0fb3aaf144d3e895e0f5a59226393 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:55:05.251706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bc13a-20d4-4114-9124-4efff81aa107 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:05.348001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bc13a-20d4-4114-9124-4efff81aa107 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:05.379520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b0560-3bd1-4f30-9ba0-1e7b9c96c6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:05.380145 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b0560-3bd1-4f30-9ba0-1e7b9c96c6e5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:05.380457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b0560-3bd1-4f30-9ba0-1e7b9c96c6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:05.380730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b0560-3bd1-4f30-9ba0-1e7b9c96c6e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:05.443111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b0560-3bd1-4f30-9ba0-1e7b9c96c6e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:05.444571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b0560-3bd1-4f30-9ba0-1e7b9c96c6e5 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:05.539860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 595/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:55:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:55:05.545751 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4c09d-221b-4637-959e-170665df9047 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:05.642055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4c09d-221b-4637-959e-170665df9047 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:05.674219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8d440-3c6a-488c-8658-95cf02b25fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:05.675060 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d440-3c6a-488c-8658-95cf02b25fca None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:05.675337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d440-3c6a-488c-8658-95cf02b25fca None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:05.675607 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d440-3c6a-488c-8658-95cf02b25fca None admin] PATH_INFO: `/v3/projects/86970b006441461ca5bc76fc86a5ad67` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:05.676781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8d440-3c6a-488c-8658-95cf02b25fca None admin] RBAC: Authorizing `identity:get_project(project_id=86970b006441461ca5bc76fc86a5ad67)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:05.678215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8d440-3c6a-488c-8658-95cf02b25fca None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:05.679871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 589/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:55:05 2022] GET /identity/v3/projects/86970b006441461ca5bc76fc86a5ad67 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:55:05.687274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b0560-3bd1-4f30-9ba0-1e7b9c96c6e5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:05.779177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b0560-3bd1-4f30-9ba0-1e7b9c96c6e5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:05.811142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531f1aa-b1e6-4f2f-a7cd-8eeb9dde4bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:05.812043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f1aa-b1e6-4f2f-a7cd-8eeb9dde4bb4 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:05.812355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f1aa-b1e6-4f2f-a7cd-8eeb9dde4bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:05.812630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f1aa-b1e6-4f2f-a7cd-8eeb9dde4bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:05.813445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531f1aa-b1e6-4f2f-a7cd-8eeb9dde4bb4 None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=86970b006441461ca5bc76fc86a5ad67, user.id=4fa0fb3aaf144d3e895e0f5a59226393) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:55:05.813754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531f1aa-b1e6-4f2f-a7cd-8eeb9dde4bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:05.815182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531f1aa-b1e6-4f2f-a7cd-8eeb9dde4bb4 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:05.820334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 596/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:55:05 2022] GET /identity/v3/role_assignments?user.id=4fa0fb3aaf144d3e895e0f5a59226393&scope.project.id=86970b006441461ca5bc76fc86a5ad67&role.id=3db33dfd3d6544fd81933007633fc56a => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:55:07.995150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad01e8c-69a6-4395-aab0-f3d77378ffad None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:07.995691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad01e8c-69a6-4395-aab0-f3d77378ffad None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:07.995691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad01e8c-69a6-4395-aab0-f3d77378ffad None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:07.997604 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 590/1186] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:55:08.003115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5f501-4329-4ea5-a51c-53d2d031c2e8 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:08.003598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5f501-4329-4ea5-a51c-53d2d031c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:08.003764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5f501-4329-4ea5-a51c-53d2d031c2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:08.020740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-5da5f501-4329-4ea5-a51c-53d2d031c2e8 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:55:08.021898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5da5f501-4329-4ea5-a51c-53d2d031c2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:55:08.084506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 597/1187] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:55:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:55:08.107039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad01e8c-69a6-4395-aab0-f3d77378ffad None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:08.202184 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad01e8c-69a6-4395-aab0-f3d77378ffad None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:08.233832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8c467-9bcd-4550-b231-846d65093b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:08.234592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8c467-9bcd-4550-b231-846d65093b07 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:08.234869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8c467-9bcd-4550-b231-846d65093b07 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:08.235138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8c467-9bcd-4550-b231-846d65093b07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:08.244679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8c467-9bcd-4550-b231-846d65093b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-51a8c467-9bcd-4550-b231-846d65093b07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:55:08.252820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:55:08.253882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:55:08.254869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 591/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:55:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:55:08.259917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5f501-4329-4ea5-a51c-53d2d031c2e8 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:08.352732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5f501-4329-4ea5-a51c-53d2d031c2e8 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:08.384978 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b28916-beb5-4cc9-87de-9a690a4388d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:08.385629 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b28916-beb5-4cc9-87de-9a690a4388d1 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:08.385910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b28916-beb5-4cc9-87de-9a690a4388d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:08.386183 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b28916-beb5-4cc9-87de-9a690a4388d1 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:08.386918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b28916-beb5-4cc9-87de-9a690a4388d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:55:08.387227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b28916-beb5-4cc9-87de-9a690a4388d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:08.388828 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b28916-beb5-4cc9-87de-9a690a4388d1 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:08.396433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 598/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:55:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:55:08.402107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8c467-9bcd-4550-b231-846d65093b07 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:08.493641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8c467-9bcd-4550-b231-846d65093b07 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:08.524859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f3a5f-58e7-48fe-9766-cf023d32a21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:08.525655 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f3a5f-58e7-48fe-9766-cf023d32a21a None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:08.526411 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f3a5f-58e7-48fe-9766-cf023d32a21a None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:08.526411 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f3a5f-58e7-48fe-9766-cf023d32a21a None admin] PATH_INFO: `/v3/users/4fa0fb3aaf144d3e895e0f5a59226393` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:08.527345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f3a5f-58e7-48fe-9766-cf023d32a21a None admin] RBAC: Authorizing `identity:get_user(user_id=4fa0fb3aaf144d3e895e0f5a59226393)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:08.529626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f3a5f-58e7-48fe-9766-cf023d32a21a None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:08.531253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 592/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:55:08 2022] GET /identity/v3/users/4fa0fb3aaf144d3e895e0f5a59226393 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:55:08.536833 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b28916-beb5-4cc9-87de-9a690a4388d1 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:08.631035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b28916-beb5-4cc9-87de-9a690a4388d1 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:08.662484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc88e7f-d789-42ac-bc60-2aa6e59c2e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:08.663332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc88e7f-d789-42ac-bc60-2aa6e59c2e51 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:08.663614 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc88e7f-d789-42ac-bc60-2aa6e59c2e51 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:08.663889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc88e7f-d789-42ac-bc60-2aa6e59c2e51 None admin] PATH_INFO: `/v3/projects/86970b006441461ca5bc76fc86a5ad67` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:08.665071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc88e7f-d789-42ac-bc60-2aa6e59c2e51 None admin] RBAC: Authorizing `identity:get_project(project_id=86970b006441461ca5bc76fc86a5ad67)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:08.666496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc88e7f-d789-42ac-bc60-2aa6e59c2e51 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:08.668141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 599/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:55:08 2022] GET /identity/v3/projects/86970b006441461ca5bc76fc86a5ad67 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:55:08.673918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f3a5f-58e7-48fe-9766-cf023d32a21a None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:08.767825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f3a5f-58e7-48fe-9766-cf023d32a21a None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:08.798696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da31b3-aea5-48ce-8619-66dece9948d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:08.799508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da31b3-aea5-48ce-8619-66dece9948d3 None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:08.799789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da31b3-aea5-48ce-8619-66dece9948d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:08.800063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da31b3-aea5-48ce-8619-66dece9948d3 None admin] PATH_INFO: `/v3/projects/86970b006441461ca5bc76fc86a5ad67/users/4fa0fb3aaf144d3e895e0f5a59226393/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:08.802010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da31b3-aea5-48ce-8619-66dece9948d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=86970b006441461ca5bc76fc86a5ad67, user_id=4fa0fb3aaf144d3e895e0f5a59226393, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:08.803424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da31b3-aea5-48ce-8619-66dece9948d3 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:08.816504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 593/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:55:08 2022] PUT /identity/v3/projects/86970b006441461ca5bc76fc86a5ad67/users/4fa0fb3aaf144d3e895e0f5a59226393/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 11:55:10.997867 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ed0af-8f5f-4a33-9eb4-4bee894637e6 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:10.998416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ed0af-8f5f-4a33-9eb4-4bee894637e6 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:10.998416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ed0af-8f5f-4a33-9eb4-4bee894637e6 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:10.999773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 600/1193] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:55:11.005177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a6317-ea60-4d99-b24c-ea06459209b5 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:11.005582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a6317-ea60-4d99-b24c-ea06459209b5 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:11.005739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a6317-ea60-4d99-b24c-ea06459209b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:11.021995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-968a6317-ea60-4d99-b24c-ea06459209b5 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:55:11.023166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-968a6317-ea60-4d99-b24c-ea06459209b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:55:11.086584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 594/1194] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:55:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:55:11.110847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ed0af-8f5f-4a33-9eb4-4bee894637e6 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:11.207149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ed0af-8f5f-4a33-9eb4-4bee894637e6 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:11.238831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb4d67-8666-4da0-9f81-86d3db0d72a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:11.239604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb4d67-8666-4da0-9f81-86d3db0d72a5 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:11.239887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb4d67-8666-4da0-9f81-86d3db0d72a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:11.240163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb4d67-8666-4da0-9f81-86d3db0d72a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:11.249799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb4d67-8666-4da0-9f81-86d3db0d72a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-f8cb4d67-8666-4da0-9f81-86d3db0d72a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:55:11.257303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:55:11.258364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:55:11.259393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 601/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:55:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:55:11.265035 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a6317-ea60-4d99-b24c-ea06459209b5 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:11.365117 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a6317-ea60-4d99-b24c-ea06459209b5 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:11.396353 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d06dce-1c47-4a62-bf81-d5554ba3c257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:11.397002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d06dce-1c47-4a62-bf81-d5554ba3c257 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:11.397280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d06dce-1c47-4a62-bf81-d5554ba3c257 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:11.397551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d06dce-1c47-4a62-bf81-d5554ba3c257 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:11.398279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d06dce-1c47-4a62-bf81-d5554ba3c257 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:55:11.398583 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d06dce-1c47-4a62-bf81-d5554ba3c257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:11.399928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d06dce-1c47-4a62-bf81-d5554ba3c257 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:11.408198 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 595/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:55:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:55:11.413991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb4d67-8666-4da0-9f81-86d3db0d72a5 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:11.508622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb4d67-8666-4da0-9f81-86d3db0d72a5 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:11.540649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dc651-9778-4613-841a-34b130e1e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:11.541514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc651-9778-4613-841a-34b130e1e1bf None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:11.541791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc651-9778-4613-841a-34b130e1e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:11.542057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc651-9778-4613-841a-34b130e1e1bf None admin] PATH_INFO: `/v3/users/4fa0fb3aaf144d3e895e0f5a59226393` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:11.543214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dc651-9778-4613-841a-34b130e1e1bf None admin] RBAC: Authorizing `identity:get_user(user_id=4fa0fb3aaf144d3e895e0f5a59226393)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:11.544720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dc651-9778-4613-841a-34b130e1e1bf None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:11.546317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 602/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Tue May 17 11:55:11 2022] GET /identity/v3/users/4fa0fb3aaf144d3e895e0f5a59226393 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:55:11.552034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d06dce-1c47-4a62-bf81-d5554ba3c257 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:11.646823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d06dce-1c47-4a62-bf81-d5554ba3c257 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:11.679060 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266eaab-d956-4b2f-bf75-57580b2294ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:11.679693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266eaab-d956-4b2f-bf75-57580b2294ff None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:11.679971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266eaab-d956-4b2f-bf75-57580b2294ff None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:11.680265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266eaab-d956-4b2f-bf75-57580b2294ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:11.742316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266eaab-d956-4b2f-bf75-57580b2294ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:11.743734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266eaab-d956-4b2f-bf75-57580b2294ff None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:11.834674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 596/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:55:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 11:55:11.840543 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dc651-9778-4613-841a-34b130e1e1bf None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:11.935433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dc651-9778-4613-841a-34b130e1e1bf None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:11.966601 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf4f43-2756-4e4c-ad5f-34bc0271b025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:11.967440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf4f43-2756-4e4c-ad5f-34bc0271b025 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:11.967721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf4f43-2756-4e4c-ad5f-34bc0271b025 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:11.967994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf4f43-2756-4e4c-ad5f-34bc0271b025 None admin] PATH_INFO: `/v3/projects/86970b006441461ca5bc76fc86a5ad67` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:11.969330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf4f43-2756-4e4c-ad5f-34bc0271b025 None admin] RBAC: Authorizing `identity:get_project(project_id=86970b006441461ca5bc76fc86a5ad67)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:11.970759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf4f43-2756-4e4c-ad5f-34bc0271b025 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:11.972466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 603/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Tue May 17 11:55:11 2022] GET /identity/v3/projects/86970b006441461ca5bc76fc86a5ad67 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:55:11.978505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266eaab-d956-4b2f-bf75-57580b2294ff None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:55:12.071738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266eaab-d956-4b2f-bf75-57580b2294ff None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:55:12.103019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a5b5a-5454-4ec7-b578-ae32ebec8980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:55:12.103599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5b5a-5454-4ec7-b578-ae32ebec8980 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:55:12.103879 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5b5a-5454-4ec7-b578-ae32ebec8980 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:55:12.104150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a5b5a-5454-4ec7-b578-ae32ebec8980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:55:12.104993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a5b5a-5454-4ec7-b578-ae32ebec8980 None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=86970b006441461ca5bc76fc86a5ad67, user.id=4fa0fb3aaf144d3e895e0f5a59226393) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:55:12.105304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a5b5a-5454-4ec7-b578-ae32ebec8980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:55:12.107336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a5b5a-5454-4ec7-b578-ae32ebec8980 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:55:12.112910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 597/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:55:11 2022] GET /identity/v3/role_assignments?user.id=4fa0fb3aaf144d3e895e0f5a59226393&scope.project.id=86970b006441461ca5bc76fc86a5ad67&role.id=3db33dfd3d6544fd81933007633fc56a => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:12.759111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d1b48-7642-4731-a579-28c309ca06e8 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:12.759678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d1b48-7642-4731-a579-28c309ca06e8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:12.759770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d1b48-7642-4731-a579-28c309ca06e8 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:12.761998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 604/1201] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:56:12.767949 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c781-bdf1-4103-bed9-09a0dad79e3b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:12.768443 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c781-bdf1-4103-bed9-09a0dad79e3b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:12.768642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c781-bdf1-4103-bed9-09a0dad79e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:12.787626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-dea0c781-bdf1-4103-bed9-09a0dad79e3b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:56:12.789073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-dea0c781-bdf1-4103-bed9-09a0dad79e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:56:12.877889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 598/1202] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:56:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:56:12.906535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d1b48-7642-4731-a579-28c309ca06e8 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:13.066890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d1b48-7642-4731-a579-28c309ca06e8 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:13.124549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f8823-bffb-4c6c-b3f5-4d9a7ed3aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:13.125344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f8823-bffb-4c6c-b3f5-4d9a7ed3aa57 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:13.125626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f8823-bffb-4c6c-b3f5-4d9a7ed3aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:13.125893 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f8823-bffb-4c6c-b3f5-4d9a7ed3aa57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:13.138354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f8823-bffb-4c6c-b3f5-4d9a7ed3aa57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:13.139914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f8823-bffb-4c6c-b3f5-4d9a7ed3aa57 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-2e5f8823-bffb-4c6c-b3f5-4d9a7ed3aa57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:13.158798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:13.159839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:13.160883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:13.160883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:13.160883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:13.160883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:13.160883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 605/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:13.166639 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c781-bdf1-4103-bed9-09a0dad79e3b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:13.297240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c781-bdf1-4103-bed9-09a0dad79e3b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:13.354469 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b5b74-b2fb-4ed8-9098-2d8b44f8c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:13.355442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b5b74-b2fb-4ed8-9098-2d8b44f8c760 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:13.355885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b5b74-b2fb-4ed8-9098-2d8b44f8c760 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:13.356395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b5b74-b2fb-4ed8-9098-2d8b44f8c760 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:13.357691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b5b74-b2fb-4ed8-9098-2d8b44f8c760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:13.358238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b5b74-b2fb-4ed8-9098-2d8b44f8c760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:13.360715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b5b74-b2fb-4ed8-9098-2d8b44f8c760 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:13.380145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 599/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:13.385737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f8823-bffb-4c6c-b3f5-4d9a7ed3aa57 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:13.520469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f8823-bffb-4c6c-b3f5-4d9a7ed3aa57 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:13.563832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5104c96-e886-43f6-b5ba-9766e5c31fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:13.563832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5104c96-e886-43f6-b5ba-9766e5c31fe2 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:13.563832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5104c96-e886-43f6-b5ba-9766e5c31fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:13.563832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5104c96-e886-43f6-b5ba-9766e5c31fe2 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:13.564336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5104c96-e886-43f6-b5ba-9766e5c31fe2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:13.564336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5104c96-e886-43f6-b5ba-9766e5c31fe2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:13.584670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 606/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Tue May 17 11:56:13 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:56:16.192910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242820f5-c26a-4907-a973-b83681530f54 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:16.193571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242820f5-c26a-4907-a973-b83681530f54 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:16.193571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242820f5-c26a-4907-a973-b83681530f54 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:16.194835 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 600/1206] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:56:16.200461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed511c9-1591-48a7-aa83-f361dfc1bb4b None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:16.200888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed511c9-1591-48a7-aa83-f361dfc1bb4b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:16.201086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed511c9-1591-48a7-aa83-f361dfc1bb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:16.219280 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1ed511c9-1591-48a7-aa83-f361dfc1bb4b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:56:16.220585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1ed511c9-1591-48a7-aa83-f361dfc1bb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:56:16.295773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 607/1207] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:56:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:56:16.322439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242820f5-c26a-4907-a973-b83681530f54 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:16.443502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242820f5-c26a-4907-a973-b83681530f54 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:16.483387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeba639-c060-4832-a276-693fdda63c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:16.484439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba639-c060-4832-a276-693fdda63c7b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:16.484630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba639-c060-4832-a276-693fdda63c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:16.484882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba639-c060-4832-a276-693fdda63c7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:16.498752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeba639-c060-4832-a276-693fdda63c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-faeba639-c060-4832-a276-693fdda63c7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:56:16.507536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:16.509460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:16.510570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 601/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:56:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:16.518749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed511c9-1591-48a7-aa83-f361dfc1bb4b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:16.633292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed511c9-1591-48a7-aa83-f361dfc1bb4b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:16.672735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06373dd3-6510-48e8-9238-8bdadd3a24af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:16.673116 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06373dd3-6510-48e8-9238-8bdadd3a24af None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:16.673364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06373dd3-6510-48e8-9238-8bdadd3a24af None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:16.673678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06373dd3-6510-48e8-9238-8bdadd3a24af None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:16.674493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06373dd3-6510-48e8-9238-8bdadd3a24af None admin] RBAC: Adding query filter params (name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:16.674824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06373dd3-6510-48e8-9238-8bdadd3a24af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:16.676501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06373dd3-6510-48e8-9238-8bdadd3a24af None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:16.686593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 608/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:56:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:16.692489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeba639-c060-4832-a276-693fdda63c7b None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:16.811381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeba639-c060-4832-a276-693fdda63c7b None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:16.854717 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e23f97-c95b-4fa1-bc2b-6e98ce133f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:16.856875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e23f97-c95b-4fa1-bc2b-6e98ce133f1e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:16.858109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e23f97-c95b-4fa1-bc2b-6e98ce133f1e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:16.858109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e23f97-c95b-4fa1-bc2b-6e98ce133f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:16.868056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e23f97-c95b-4fa1-bc2b-6e98ce133f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:16.869572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e23f97-c95b-4fa1-bc2b-6e98ce133f1e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-b6e23f97-c95b-4fa1-bc2b-6e98ce133f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:16.888877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:16.889881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:16.890750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:16.890750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:16.890750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:16.890750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:16.895225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 602/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:16.896243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06373dd3-6510-48e8-9238-8bdadd3a24af None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:17.001652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06373dd3-6510-48e8-9238-8bdadd3a24af None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:17.039682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59428d4-40a1-455f-9c06-5e3d5e8a57d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:17.040455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59428d4-40a1-455f-9c06-5e3d5e8a57d0 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:17.040653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59428d4-40a1-455f-9c06-5e3d5e8a57d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:17.040925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59428d4-40a1-455f-9c06-5e3d5e8a57d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:17.041679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59428d4-40a1-455f-9c06-5e3d5e8a57d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:17.041956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59428d4-40a1-455f-9c06-5e3d5e8a57d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:17.044006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59428d4-40a1-455f-9c06-5e3d5e8a57d0 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:17.058904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 609/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:56:17.065088 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e23f97-c95b-4fa1-bc2b-6e98ce133f1e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:17.188762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e23f97-c95b-4fa1-bc2b-6e98ce133f1e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:17.231014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4f8a1-aee9-4a4b-b70f-f75638642db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:17.231819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f8a1-aee9-4a4b-b70f-f75638642db4 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:17.232144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f8a1-aee9-4a4b-b70f-f75638642db4 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:17.232459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f8a1-aee9-4a4b-b70f-f75638642db4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:17.240822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4f8a1-aee9-4a4b-b70f-f75638642db4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:17.242326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4f8a1-aee9-4a4b-b70f-f75638642db4 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-91b4f8a1-aee9-4a4b-b70f-f75638642db4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:56:17.258223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:17.259883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:17.260994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:17.260994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:17.260994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:56:17.260994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:56:17.260994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:56:17.260994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:56:17.260994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:56:17.260994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:56:17.260994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:17.260994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:17.264297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 603/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:17.265628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59428d4-40a1-455f-9c06-5e3d5e8a57d0 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:17.380787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59428d4-40a1-455f-9c06-5e3d5e8a57d0 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:17.424260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd6cae-027f-4f4f-b420-8f2bfa5a656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:17.425016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd6cae-027f-4f4f-b420-8f2bfa5a656a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:17.425324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd6cae-027f-4f4f-b420-8f2bfa5a656a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:17.425689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd6cae-027f-4f4f-b420-8f2bfa5a656a None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:17.426640 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd6cae-027f-4f4f-b420-8f2bfa5a656a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:17.426951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd6cae-027f-4f4f-b420-8f2bfa5a656a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:17.428413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd6cae-027f-4f4f-b420-8f2bfa5a656a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:17.451106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 610/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Tue May 17 11:56:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:56:17.457651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4f8a1-aee9-4a4b-b70f-f75638642db4 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:17.578914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4f8a1-aee9-4a4b-b70f-f75638642db4 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:17.617611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138722a-5bed-4616-a51a-765cdc4ee2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:17.618415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138722a-5bed-4616-a51a-765cdc4ee2b1 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:17.618710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138722a-5bed-4616-a51a-765cdc4ee2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:17.618990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138722a-5bed-4616-a51a-765cdc4ee2b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:17.697330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138722a-5bed-4616-a51a-765cdc4ee2b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:17.699986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138722a-5bed-4616-a51a-765cdc4ee2b1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:17.821823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 604/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:56:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 11:56:17.828705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd6cae-027f-4f4f-b420-8f2bfa5a656a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:17.939317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd6cae-027f-4f4f-b420-8f2bfa5a656a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:17.975436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92d5ea-2e5e-466f-aa49-5514bbf35a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:17.976157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92d5ea-2e5e-466f-aa49-5514bbf35a3c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:17.976467 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92d5ea-2e5e-466f-aa49-5514bbf35a3c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:17.976747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92d5ea-2e5e-466f-aa49-5514bbf35a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:17.988049 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92d5ea-2e5e-466f-aa49-5514bbf35a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:17.989535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92d5ea-2e5e-466f-aa49-5514bbf35a3c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-ed92d5ea-2e5e-466f-aa49-5514bbf35a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:18.009458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:18.010641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:18.012068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:18.012068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:18.012068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:18.012068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:18.014018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 611/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:18.020660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138722a-5bed-4616-a51a-765cdc4ee2b1 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:18.127273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138722a-5bed-4616-a51a-765cdc4ee2b1 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:18.163869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a390d-9216-4528-83da-4f17a4a68553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:18.165099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a390d-9216-4528-83da-4f17a4a68553 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:18.165647 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a390d-9216-4528-83da-4f17a4a68553 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:18.166935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a390d-9216-4528-83da-4f17a4a68553 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:18.168566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a390d-9216-4528-83da-4f17a4a68553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:18.169293 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a390d-9216-4528-83da-4f17a4a68553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:18.171186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a390d-9216-4528-83da-4f17a4a68553 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:18.185573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 605/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:56:18.191140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92d5ea-2e5e-466f-aa49-5514bbf35a3c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:18.296834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92d5ea-2e5e-466f-aa49-5514bbf35a3c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:18.341473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5751fd-0294-42b6-9718-b7c83b571405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:18.342488 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5751fd-0294-42b6-9718-b7c83b571405 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:18.342930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5751fd-0294-42b6-9718-b7c83b571405 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:18.343270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5751fd-0294-42b6-9718-b7c83b571405 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:18.350745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5751fd-0294-42b6-9718-b7c83b571405 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:18.352215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5751fd-0294-42b6-9718-b7c83b571405 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-3a5751fd-0294-42b6-9718-b7c83b571405 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:56:18.368097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:18.369208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:18.370202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:56:18.370202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:56:18.370202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:56:18.370202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:56:18.370202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:56:18.370202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:56:18.370202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:18.370202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:18.370202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 612/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:56:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:18.375549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a390d-9216-4528-83da-4f17a4a68553 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:18.494508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a390d-9216-4528-83da-4f17a4a68553 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:18.530418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22083a-b57d-41b3-8731-4085fc7bb384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:18.531300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22083a-b57d-41b3-8731-4085fc7bb384 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:18.531733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22083a-b57d-41b3-8731-4085fc7bb384 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:18.532151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22083a-b57d-41b3-8731-4085fc7bb384 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:18.533136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22083a-b57d-41b3-8731-4085fc7bb384 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:18.533636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22083a-b57d-41b3-8731-4085fc7bb384 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:18.535254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22083a-b57d-41b3-8731-4085fc7bb384 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:18.548538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 606/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:18.554612 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5751fd-0294-42b6-9718-b7c83b571405 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:18.659103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5751fd-0294-42b6-9718-b7c83b571405 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:18.694732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274e65-61a0-4832-ad72-c8129d2284f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:18.695423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274e65-61a0-4832-ad72-c8129d2284f0 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:18.695735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274e65-61a0-4832-ad72-c8129d2284f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:18.695975 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274e65-61a0-4832-ad72-c8129d2284f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:18.696797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2274e65-61a0-4832-ad72-c8129d2284f0 None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=c5222a62941948229324ec8c073caf86) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:18.697106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2274e65-61a0-4832-ad72-c8129d2284f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:18.698542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2274e65-61a0-4832-ad72-c8129d2284f0 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:18.712217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 613/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:56:18 2022] GET /identity/v3/role_assignments?user.id=c5222a62941948229324ec8c073caf86&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:20.953234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeece16-ff62-434d-ac19-1336dd9267af None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:20.953780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeece16-ff62-434d-ac19-1336dd9267af None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:20.953780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeece16-ff62-434d-ac19-1336dd9267af None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:20.955278 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 607/1220] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:56:20.962771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3523a-1b5a-42ed-be0f-f87cbaf90338 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:20.962771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3523a-1b5a-42ed-be0f-f87cbaf90338 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:20.962771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3523a-1b5a-42ed-be0f-f87cbaf90338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:20.977872 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-bbf3523a-1b5a-42ed-be0f-f87cbaf90338 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:56:20.979052 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bbf3523a-1b5a-42ed-be0f-f87cbaf90338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:56:21.055218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 614/1221] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:56:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:56:21.078689 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeece16-ff62-434d-ac19-1336dd9267af None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:21.190293 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeece16-ff62-434d-ac19-1336dd9267af None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:21.225735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54842b15-96ca-4cfd-bdce-0c9f9a033f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:21.226889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54842b15-96ca-4cfd-bdce-0c9f9a033f5d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:21.227184 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54842b15-96ca-4cfd-bdce-0c9f9a033f5d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:21.227499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54842b15-96ca-4cfd-bdce-0c9f9a033f5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:21.240053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54842b15-96ca-4cfd-bdce-0c9f9a033f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-54842b15-96ca-4cfd-bdce-0c9f9a033f5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:56:21.249672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:21.250803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:21.251816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 608/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:56:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:21.256919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3523a-1b5a-42ed-be0f-f87cbaf90338 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:21.357510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3523a-1b5a-42ed-be0f-f87cbaf90338 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:21.395602 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea615b-8098-4226-8479-a52bd77f194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:21.396486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea615b-8098-4226-8479-a52bd77f194b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:21.396774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea615b-8098-4226-8479-a52bd77f194b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:21.397051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea615b-8098-4226-8479-a52bd77f194b None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:21.397804 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea615b-8098-4226-8479-a52bd77f194b None admin] RBAC: Adding query filter params (name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:21.398169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea615b-8098-4226-8479-a52bd77f194b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:21.400052 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea615b-8098-4226-8479-a52bd77f194b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:21.409004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 615/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:56:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:56:21.414805 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54842b15-96ca-4cfd-bdce-0c9f9a033f5d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:21.529296 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54842b15-96ca-4cfd-bdce-0c9f9a033f5d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:21.563349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40376-4e44-4ee4-8494-39a696134306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:21.564136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40376-4e44-4ee4-8494-39a696134306 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:21.564481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40376-4e44-4ee4-8494-39a696134306 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:21.564739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40376-4e44-4ee4-8494-39a696134306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:21.575911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f40376-4e44-4ee4-8494-39a696134306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:21.577382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f40376-4e44-4ee4-8494-39a696134306 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-a3f40376-4e44-4ee4-8494-39a696134306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:21.594005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:21.594921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:21.595871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:21.595871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:21.595871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:21.595871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:21.595871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 609/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:56:21.601075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea615b-8098-4226-8479-a52bd77f194b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:21.704631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea615b-8098-4226-8479-a52bd77f194b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:21.737914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0d3c-bdd4-4cf5-bd94-2b0111b8d45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:21.738576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0d3c-bdd4-4cf5-bd94-2b0111b8d45b None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:21.738860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0d3c-bdd4-4cf5-bd94-2b0111b8d45b None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:21.739132 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0d3c-bdd4-4cf5-bd94-2b0111b8d45b None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:21.739845 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0d3c-bdd4-4cf5-bd94-2b0111b8d45b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:21.740151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0d3c-bdd4-4cf5-bd94-2b0111b8d45b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:21.741538 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0d3c-bdd4-4cf5-bd94-2b0111b8d45b None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:21.753990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 616/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:21.759672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40376-4e44-4ee4-8494-39a696134306 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:21.861338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40376-4e44-4ee4-8494-39a696134306 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:21.895617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf78522-b648-4447-9e64-14bb60d8c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:21.896562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf78522-b648-4447-9e64-14bb60d8c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:21.896842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf78522-b648-4447-9e64-14bb60d8c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:21.897114 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf78522-b648-4447-9e64-14bb60d8c9d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:21.905376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf78522-b648-4447-9e64-14bb60d8c9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:21.906856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf78522-b648-4447-9e64-14bb60d8c9d5 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-4bf78522-b648-4447-9e64-14bb60d8c9d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:56:21.921468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:21.922618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:21.923565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:21.923565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:21.923565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:56:21.923565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:56:21.923565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:56:21.923565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:56:21.923565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:56:21.923565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:56:21.923565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:21.923565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:21.923565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 610/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:21.928555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0d3c-bdd4-4cf5-bd94-2b0111b8d45b None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:22.035706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0d3c-bdd4-4cf5-bd94-2b0111b8d45b None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:22.074774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c63dc5-986f-4656-8481-c99a5dfa1d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:22.075652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c63dc5-986f-4656-8481-c99a5dfa1d46 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:22.075989 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c63dc5-986f-4656-8481-c99a5dfa1d46 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:22.076320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c63dc5-986f-4656-8481-c99a5dfa1d46 None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:22.077306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c63dc5-986f-4656-8481-c99a5dfa1d46 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:22.077706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c63dc5-986f-4656-8481-c99a5dfa1d46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:22.079453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c63dc5-986f-4656-8481-c99a5dfa1d46 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:22.098184 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 617/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Tue May 17 11:56:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:22.104425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf78522-b648-4447-9e64-14bb60d8c9d5 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:22.208759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf78522-b648-4447-9e64-14bb60d8c9d5 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:22.244166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970e8d9-aed2-4b0d-a1c0-5db451b21909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:22.245013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970e8d9-aed2-4b0d-a1c0-5db451b21909 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:22.245364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970e8d9-aed2-4b0d-a1c0-5db451b21909 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:22.246220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970e8d9-aed2-4b0d-a1c0-5db451b21909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:22.257425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970e8d9-aed2-4b0d-a1c0-5db451b21909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:22.258880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970e8d9-aed2-4b0d-a1c0-5db451b21909 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-4970e8d9-aed2-4b0d-a1c0-5db451b21909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:22.276683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:22.277966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:22.279236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:22.279236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:22.279236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:22.279236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:22.279236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 611/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:22.283686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c63dc5-986f-4656-8481-c99a5dfa1d46 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:22.387914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c63dc5-986f-4656-8481-c99a5dfa1d46 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:22.422473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42324db0-2f37-4141-82a5-2e6e9eb06f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:22.423227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324db0-2f37-4141-82a5-2e6e9eb06f29 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:22.423657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324db0-2f37-4141-82a5-2e6e9eb06f29 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:22.423944 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324db0-2f37-4141-82a5-2e6e9eb06f29 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:22.424798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42324db0-2f37-4141-82a5-2e6e9eb06f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:22.425218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42324db0-2f37-4141-82a5-2e6e9eb06f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:22.426656 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42324db0-2f37-4141-82a5-2e6e9eb06f29 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:22.438911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 618/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:56:22.445129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970e8d9-aed2-4b0d-a1c0-5db451b21909 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:22.575675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970e8d9-aed2-4b0d-a1c0-5db451b21909 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:22.623003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cc1d3-4f66-4547-a88b-b646ed6138ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:22.624043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cc1d3-4f66-4547-a88b-b646ed6138ca None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:22.624403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cc1d3-4f66-4547-a88b-b646ed6138ca None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:22.624654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cc1d3-4f66-4547-a88b-b646ed6138ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:22.634263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cc1d3-4f66-4547-a88b-b646ed6138ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:22.635732 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cc1d3-4f66-4547-a88b-b646ed6138ca None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-322cc1d3-4f66-4547-a88b-b646ed6138ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:56:22.657483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:22.658457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:22.659322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:56:22.659322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:56:22.659322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:56:22.659322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:56:22.659322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:56:22.659322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:56:22.659322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:22.659322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:22.659322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 612/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:56:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:22.666987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42324db0-2f37-4141-82a5-2e6e9eb06f29 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:22.786927 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42324db0-2f37-4141-82a5-2e6e9eb06f29 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:22.829178 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145205c4-37c6-4572-bc5e-9d8664deb150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:22.829922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145205c4-37c6-4572-bc5e-9d8664deb150 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:22.830250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145205c4-37c6-4572-bc5e-9d8664deb150 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:22.830557 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145205c4-37c6-4572-bc5e-9d8664deb150 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:22.831469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145205c4-37c6-4572-bc5e-9d8664deb150 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:22.831829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145205c4-37c6-4572-bc5e-9d8664deb150 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:22.833521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145205c4-37c6-4572-bc5e-9d8664deb150 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:22.850323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 619/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:56:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:56:22.858487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cc1d3-4f66-4547-a88b-b646ed6138ca None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:22.991160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cc1d3-4f66-4547-a88b-b646ed6138ca None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:23.028362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81510b3-2602-435b-a134-1463bd84f6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:23.029832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81510b3-2602-435b-a134-1463bd84f6df None admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:23.030379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81510b3-2602-435b-a134-1463bd84f6df None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:23.030859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81510b3-2602-435b-a134-1463bd84f6df None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/c5222a62941948229324ec8c073caf86/roles/50a905462253442da9d5dac9a4dd30ae` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:23.048138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81510b3-2602-435b-a134-1463bd84f6df None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=c5222a62941948229324ec8c073caf86, role_id=50a905462253442da9d5dac9a4dd30ae)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:23.049701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81510b3-2602-435b-a134-1463bd84f6df None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:23.064375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 613/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:56:22 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/c5222a62941948229324ec8c073caf86/roles/50a905462253442da9d5dac9a4dd30ae => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 11:56:25.426017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07ef4a-16c6-4a12-9d20-e2beb3c63ffd None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:25.426614 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07ef4a-16c6-4a12-9d20-e2beb3c63ffd None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:25.426614 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07ef4a-16c6-4a12-9d20-e2beb3c63ffd None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:25.427974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 620/1233] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:56:25.434016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681694c-58a2-431c-af59-15caabd2f18a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:25.434481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681694c-58a2-431c-af59-15caabd2f18a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:25.434585 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681694c-58a2-431c-af59-15caabd2f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:25.452708 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-1681694c-58a2-431c-af59-15caabd2f18a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:56:25.453907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1681694c-58a2-431c-af59-15caabd2f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:56:25.532255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 614/1234] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:56:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:56:25.556031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07ef4a-16c6-4a12-9d20-e2beb3c63ffd None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:25.659463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07ef4a-16c6-4a12-9d20-e2beb3c63ffd None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:25.693804 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44f7bc-a976-4f80-af1b-709a54e17f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:25.694502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f7bc-a976-4f80-af1b-709a54e17f65 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:25.694783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f7bc-a976-4f80-af1b-709a54e17f65 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:25.695054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f7bc-a976-4f80-af1b-709a54e17f65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:25.706547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44f7bc-a976-4f80-af1b-709a54e17f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-fb44f7bc-a976-4f80-af1b-709a54e17f65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:56:25.715149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:25.716326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:25.717139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 621/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Tue May 17 11:56:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:25.723061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681694c-58a2-431c-af59-15caabd2f18a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:25.831260 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681694c-58a2-431c-af59-15caabd2f18a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:25.868575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d1f73-80fd-4ca1-b078-0987ddbb769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:25.869424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d1f73-80fd-4ca1-b078-0987ddbb769c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:25.869795 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d1f73-80fd-4ca1-b078-0987ddbb769c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:25.870139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d1f73-80fd-4ca1-b078-0987ddbb769c None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:25.871618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d1f73-80fd-4ca1-b078-0987ddbb769c None admin] RBAC: Adding query filter params (name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:25.871932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d1f73-80fd-4ca1-b078-0987ddbb769c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:25.873721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d1f73-80fd-4ca1-b078-0987ddbb769c None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:25.882995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 615/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Tue May 17 11:56:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:25.889122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44f7bc-a976-4f80-af1b-709a54e17f65 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:25.994103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44f7bc-a976-4f80-af1b-709a54e17f65 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:26.027562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c3133-cc40-45b9-b290-bd7f3c524262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:26.028454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3133-cc40-45b9-b290-bd7f3c524262 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:26.028750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3133-cc40-45b9-b290-bd7f3c524262 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:26.029007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3133-cc40-45b9-b290-bd7f3c524262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:26.039782 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c3133-cc40-45b9-b290-bd7f3c524262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:26.041251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c3133-cc40-45b9-b290-bd7f3c524262 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-1b5c3133-cc40-45b9-b290-bd7f3c524262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:26.058454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:26.059586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:26.060596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:26.060596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:26.060596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:26.060596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:26.060596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 622/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:56:26.065776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d1f73-80fd-4ca1-b078-0987ddbb769c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:26.167041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d1f73-80fd-4ca1-b078-0987ddbb769c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:26.202645 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a5a2-d587-4db3-9a15-1dd436add3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:26.203340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a5a2-d587-4db3-9a15-1dd436add3f0 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:26.203629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a5a2-d587-4db3-9a15-1dd436add3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:26.203884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2a5a2-d587-4db3-9a15-1dd436add3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:26.204708 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2a5a2-d587-4db3-9a15-1dd436add3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:26.205069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2a5a2-d587-4db3-9a15-1dd436add3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:26.206598 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2a5a2-d587-4db3-9a15-1dd436add3f0 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:26.225026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 616/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:26.231617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c3133-cc40-45b9-b290-bd7f3c524262 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:26.338098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c3133-cc40-45b9-b290-bd7f3c524262 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:26.373727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ace82-f345-4149-ac39-8e9c79f29feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:26.374533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ace82-f345-4149-ac39-8e9c79f29feb None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:26.376055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ace82-f345-4149-ac39-8e9c79f29feb None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:26.376055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ace82-f345-4149-ac39-8e9c79f29feb None admin] PATH_INFO: `/v3/users/placement` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:26.382870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ace82-f345-4149-ac39-8e9c79f29feb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:26.384340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ace82-f345-4149-ac39-8e9c79f29feb None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-8c7ace82-f345-4149-ac39-8e9c79f29feb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:56:26.399065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:26.400091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:26.401079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:26.401079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:26.401079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:56:26.401079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:56:26.401079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:56:26.401079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:56:26.401079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:56:26.401079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:56:26.401079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:26.401079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:26.401079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 623/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:26.406387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a5a2-d587-4db3-9a15-1dd436add3f0 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:26.508832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2a5a2-d587-4db3-9a15-1dd436add3f0 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:26.548735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15357a9-49a1-4e42-90c9-c79c4424b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:26.549631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15357a9-49a1-4e42-90c9-c79c4424b219 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:26.549995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15357a9-49a1-4e42-90c9-c79c4424b219 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:26.550299 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15357a9-49a1-4e42-90c9-c79c4424b219 None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:26.551280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15357a9-49a1-4e42-90c9-c79c4424b219 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:26.551597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15357a9-49a1-4e42-90c9-c79c4424b219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:26.553058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15357a9-49a1-4e42-90c9-c79c4424b219 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:26.571891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 617/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Tue May 17 11:56:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:26.578660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ace82-f345-4149-ac39-8e9c79f29feb None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:26.690123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ace82-f345-4149-ac39-8e9c79f29feb None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:26.727432 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b59a9-f6d1-4287-8c70-89eb98b17522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:26.728075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b59a9-f6d1-4287-8c70-89eb98b17522 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:26.728385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b59a9-f6d1-4287-8c70-89eb98b17522 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:26.728659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b59a9-f6d1-4287-8c70-89eb98b17522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:26.809859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b59a9-f6d1-4287-8c70-89eb98b17522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:26.811829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b59a9-f6d1-4287-8c70-89eb98b17522 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:26.916385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 624/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:56:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:56:26.923585 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15357a9-49a1-4e42-90c9-c79c4424b219 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:27.030554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15357a9-49a1-4e42-90c9-c79c4424b219 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:27.067507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fed971-6b3f-4fa7-b87d-7ac70d565305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:27.068519 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed971-6b3f-4fa7-b87d-7ac70d565305 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:27.068801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed971-6b3f-4fa7-b87d-7ac70d565305 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:27.069110 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fed971-6b3f-4fa7-b87d-7ac70d565305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:27.081008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fed971-6b3f-4fa7-b87d-7ac70d565305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:27.082473 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fed971-6b3f-4fa7-b87d-7ac70d565305 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-88fed971-6b3f-4fa7-b87d-7ac70d565305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:27.099611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:27.100996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:27.107442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:27.107442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:27.107442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:27.107442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:27.107442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 618/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:27.107827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b59a9-f6d1-4287-8c70-89eb98b17522 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:27.213410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b59a9-f6d1-4287-8c70-89eb98b17522 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:27.248481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f623b3-e763-4d0a-907f-77c5abc4c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:27.249141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f623b3-e763-4d0a-907f-77c5abc4c731 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:27.249424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f623b3-e763-4d0a-907f-77c5abc4c731 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:27.249698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f623b3-e763-4d0a-907f-77c5abc4c731 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:27.250411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f623b3-e763-4d0a-907f-77c5abc4c731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:27.250723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f623b3-e763-4d0a-907f-77c5abc4c731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:27.252099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f623b3-e763-4d0a-907f-77c5abc4c731 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:27.263562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 625/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:27.269122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fed971-6b3f-4fa7-b87d-7ac70d565305 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:27.372878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fed971-6b3f-4fa7-b87d-7ac70d565305 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:27.409173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b493b1-3693-40d2-9d40-f46edb3bbe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:27.410059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b493b1-3693-40d2-9d40-f46edb3bbe14 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:27.410421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b493b1-3693-40d2-9d40-f46edb3bbe14 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:27.410748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b493b1-3693-40d2-9d40-f46edb3bbe14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:27.418732 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b493b1-3693-40d2-9d40-f46edb3bbe14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:27.420340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b493b1-3693-40d2-9d40-f46edb3bbe14 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-66b493b1-3693-40d2-9d40-f46edb3bbe14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:56:27.435332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:27.436442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:27.437811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:56:27.437811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:56:27.437811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:56:27.437811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:56:27.437811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:56:27.437811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:56:27.437811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:27.437811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:27.437811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 619/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:56:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:27.442689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f623b3-e763-4d0a-907f-77c5abc4c731 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:27.552882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f623b3-e763-4d0a-907f-77c5abc4c731 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:27.585672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e15b03-7a23-4571-96a2-a98cfdc7a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:27.586422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e15b03-7a23-4571-96a2-a98cfdc7a70d None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:27.586657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e15b03-7a23-4571-96a2-a98cfdc7a70d None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:27.586969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e15b03-7a23-4571-96a2-a98cfdc7a70d None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:27.587750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e15b03-7a23-4571-96a2-a98cfdc7a70d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:27.588099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e15b03-7a23-4571-96a2-a98cfdc7a70d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:27.590257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e15b03-7a23-4571-96a2-a98cfdc7a70d None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:27.602484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 626/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:56:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:27.609145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b493b1-3693-40d2-9d40-f46edb3bbe14 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:27.709796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b493b1-3693-40d2-9d40-f46edb3bbe14 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:27.744346 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51c2d6-2ed9-47c9-8ecc-bce60e9b98de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:27.745028 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51c2d6-2ed9-47c9-8ecc-bce60e9b98de None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:27.745307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51c2d6-2ed9-47c9-8ecc-bce60e9b98de None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:27.745607 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51c2d6-2ed9-47c9-8ecc-bce60e9b98de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:27.747613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51c2d6-2ed9-47c9-8ecc-bce60e9b98de None admin] RBAC: Adding query filter params (role.id=50a905462253442da9d5dac9a4dd30ae, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=c5222a62941948229324ec8c073caf86) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:27.747894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51c2d6-2ed9-47c9-8ecc-bce60e9b98de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:27.749368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51c2d6-2ed9-47c9-8ecc-bce60e9b98de None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:27.755647 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 620/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:56:27 2022] GET /identity/v3/role_assignments?user.id=c5222a62941948229324ec8c073caf86&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=50a905462253442da9d5dac9a4dd30ae => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:30.165959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55943b-2574-483f-8c23-561327331d16 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:30.166550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55943b-2574-483f-8c23-561327331d16 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:30.166550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55943b-2574-483f-8c23-561327331d16 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:30.168061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 627/1247] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:56:30.173463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab8d8c-4dd0-4475-a480-f7613ed5e63e None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:30.173879 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab8d8c-4dd0-4475-a480-f7613ed5e63e None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:30.174010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab8d8c-4dd0-4475-a480-f7613ed5e63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:30.191950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a0ab8d8c-4dd0-4475-a480-f7613ed5e63e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:56:30.193201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a0ab8d8c-4dd0-4475-a480-f7613ed5e63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:56:30.269467 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 621/1248] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:56:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:56:30.294662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55943b-2574-483f-8c23-561327331d16 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:30.406189 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55943b-2574-483f-8c23-561327331d16 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:30.449852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3269100-7231-4be3-a90c-87379c87091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:30.450683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3269100-7231-4be3-a90c-87379c87091a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:30.451105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3269100-7231-4be3-a90c-87379c87091a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:30.451498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3269100-7231-4be3-a90c-87379c87091a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:30.463838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3269100-7231-4be3-a90c-87379c87091a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-f3269100-7231-4be3-a90c-87379c87091a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:56:30.474984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:30.476215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:30.477279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 628/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:56:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:30.483416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab8d8c-4dd0-4475-a480-f7613ed5e63e None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:30.601731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab8d8c-4dd0-4475-a480-f7613ed5e63e None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:30.642313 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab1fef-c3c6-4261-9f7b-eee68873b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:30.642984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1fef-c3c6-4261-9f7b-eee68873b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:30.643278 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1fef-c3c6-4261-9f7b-eee68873b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:30.643546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab1fef-c3c6-4261-9f7b-eee68873b7c4 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:30.644319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab1fef-c3c6-4261-9f7b-eee68873b7c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:30.644630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab1fef-c3c6-4261-9f7b-eee68873b7c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:30.646008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab1fef-c3c6-4261-9f7b-eee68873b7c4 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:30.654993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 622/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:56:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:30.660966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3269100-7231-4be3-a90c-87379c87091a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:30.770937 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3269100-7231-4be3-a90c-87379c87091a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:30.805696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0e066-80a2-44bd-8d8e-076d3e4448b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:30.806483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0e066-80a2-44bd-8d8e-076d3e4448b2 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:30.806768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0e066-80a2-44bd-8d8e-076d3e4448b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:30.807045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0e066-80a2-44bd-8d8e-076d3e4448b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:30.819851 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0e066-80a2-44bd-8d8e-076d3e4448b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:30.821331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0e066-80a2-44bd-8d8e-076d3e4448b2 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-3dc0e066-80a2-44bd-8d8e-076d3e4448b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:30.838300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:30.839268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:30.840135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:30.840135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:30.840135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:30.840135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:30.840135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 629/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:30.846391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab1fef-c3c6-4261-9f7b-eee68873b7c4 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:30.954931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab1fef-c3c6-4261-9f7b-eee68873b7c4 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:30.992275 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cef61-ddde-4557-82aa-9b676ee5fa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:30.992936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cef61-ddde-4557-82aa-9b676ee5fa24 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:30.993226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cef61-ddde-4557-82aa-9b676ee5fa24 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:30.993526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285cef61-ddde-4557-82aa-9b676ee5fa24 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:30.994305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cef61-ddde-4557-82aa-9b676ee5fa24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:30.994662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cef61-ddde-4557-82aa-9b676ee5fa24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:30.997358 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285cef61-ddde-4557-82aa-9b676ee5fa24 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:31.009964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 623/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:56:31.016445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0e066-80a2-44bd-8d8e-076d3e4448b2 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:31.132656 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0e066-80a2-44bd-8d8e-076d3e4448b2 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:31.167181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975be072-91ea-43b4-ac3d-b5696d77b1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:31.169270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be072-91ea-43b4-ac3d-b5696d77b1ff None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:31.169648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be072-91ea-43b4-ac3d-b5696d77b1ff None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:31.170028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be072-91ea-43b4-ac3d-b5696d77b1ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:31.178217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975be072-91ea-43b4-ac3d-b5696d77b1ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:31.179883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975be072-91ea-43b4-ac3d-b5696d77b1ff None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-975be072-91ea-43b4-ac3d-b5696d77b1ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:56:31.196115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:31.197151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:31.198469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:31.198469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:31.198469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:56:31.198469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:56:31.198469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:56:31.198469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:56:31.198469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:56:31.198469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:56:31.198469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:31.198469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:31.198469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 630/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:31.203491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cef61-ddde-4557-82aa-9b676ee5fa24 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:31.315176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285cef61-ddde-4557-82aa-9b676ee5fa24 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:31.353123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff91cd-427e-4193-8baa-e1a3dd800d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:31.353837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff91cd-427e-4193-8baa-e1a3dd800d2d None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:31.354118 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff91cd-427e-4193-8baa-e1a3dd800d2d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:31.354390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff91cd-427e-4193-8baa-e1a3dd800d2d None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:31.355499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff91cd-427e-4193-8baa-e1a3dd800d2d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:31.355803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff91cd-427e-4193-8baa-e1a3dd800d2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:31.357447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff91cd-427e-4193-8baa-e1a3dd800d2d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:31.376917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 624/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Tue May 17 11:56:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:31.383294 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975be072-91ea-43b4-ac3d-b5696d77b1ff None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:31.486943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975be072-91ea-43b4-ac3d-b5696d77b1ff None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:31.528255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ae8fc-a8df-434a-99bd-06c222e89a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:31.529063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ae8fc-a8df-434a-99bd-06c222e89a94 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:31.529380 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ae8fc-a8df-434a-99bd-06c222e89a94 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:31.529788 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ae8fc-a8df-434a-99bd-06c222e89a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:31.607671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ae8fc-a8df-434a-99bd-06c222e89a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:31.609145 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ae8fc-a8df-434a-99bd-06c222e89a94 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:31.723918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 631/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:56:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:56:31.725237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff91cd-427e-4193-8baa-e1a3dd800d2d None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:31.833422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff91cd-427e-4193-8baa-e1a3dd800d2d None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:31.870326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67a146-35a1-431f-b0da-135f5281d3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:31.871816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a146-35a1-431f-b0da-135f5281d3b4 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:31.872095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a146-35a1-431f-b0da-135f5281d3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:31.872389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a146-35a1-431f-b0da-135f5281d3b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:31.883097 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67a146-35a1-431f-b0da-135f5281d3b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:31.884582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67a146-35a1-431f-b0da-135f5281d3b4 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-6e67a146-35a1-431f-b0da-135f5281d3b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:31.904908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:31.905982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:31.906893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:31.906893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:31.906893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:31.906893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:31.906893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 625/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:31.912137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ae8fc-a8df-434a-99bd-06c222e89a94 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:32.016366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ae8fc-a8df-434a-99bd-06c222e89a94 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:32.051117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8144b81-be69-4002-9432-354086d0ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:32.051795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144b81-be69-4002-9432-354086d0ec68 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:32.052256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144b81-be69-4002-9432-354086d0ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:32.052366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144b81-be69-4002-9432-354086d0ec68 None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:32.053080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8144b81-be69-4002-9432-354086d0ec68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:32.053383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8144b81-be69-4002-9432-354086d0ec68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:32.054764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8144b81-be69-4002-9432-354086d0ec68 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:32.068028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 632/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:32.074300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67a146-35a1-431f-b0da-135f5281d3b4 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:32.176803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67a146-35a1-431f-b0da-135f5281d3b4 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:32.211478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0b5ae-b712-407b-9602-76990fa7b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:32.212299 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0b5ae-b712-407b-9602-76990fa7b641 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:32.212577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0b5ae-b712-407b-9602-76990fa7b641 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:32.212847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0b5ae-b712-407b-9602-76990fa7b641 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:32.219989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0b5ae-b712-407b-9602-76990fa7b641 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:32.221483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0b5ae-b712-407b-9602-76990fa7b641 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-c6a0b5ae-b712-407b-9602-76990fa7b641 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:56:32.236267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:32.237484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:32.238548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:56:32.238548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:56:32.238548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:56:32.238548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:56:32.238548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:56:32.238548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:56:32.238548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:32.238548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:32.238548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 626/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:56:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:32.243403 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8144b81-be69-4002-9432-354086d0ec68 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:32.347554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8144b81-be69-4002-9432-354086d0ec68 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:32.380630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89525737-36af-4056-9ebb-b57efa5dfd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:32.381294 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525737-36af-4056-9ebb-b57efa5dfd34 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:32.381575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525737-36af-4056-9ebb-b57efa5dfd34 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:32.381847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525737-36af-4056-9ebb-b57efa5dfd34 None admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:32.382627 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89525737-36af-4056-9ebb-b57efa5dfd34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:32.382934 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89525737-36af-4056-9ebb-b57efa5dfd34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:32.384486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89525737-36af-4056-9ebb-b57efa5dfd34 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:32.397253 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 633/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:56:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:32.404094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0b5ae-b712-407b-9602-76990fa7b641 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:32.506485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0b5ae-b712-407b-9602-76990fa7b641 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:32.544638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb3d6a-6cd3-4ddb-99a3-970f4302cbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:32.545378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3d6a-6cd3-4ddb-99a3-970f4302cbfb None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:32.545696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3d6a-6cd3-4ddb-99a3-970f4302cbfb None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:32.545978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb3d6a-6cd3-4ddb-99a3-970f4302cbfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:32.546980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb3d6a-6cd3-4ddb-99a3-970f4302cbfb None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=c5222a62941948229324ec8c073caf86) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:32.547362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb3d6a-6cd3-4ddb-99a3-970f4302cbfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:32.548983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb3d6a-6cd3-4ddb-99a3-970f4302cbfb None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:32.554431 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 627/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:56:32 2022] GET /identity/v3/role_assignments?user.id=c5222a62941948229324ec8c073caf86&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=3db33dfd3d6544fd81933007633fc56a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:34.747643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939b11-175d-4946-a5b8-4ffdea2e2133 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:34.748214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939b11-175d-4946-a5b8-4ffdea2e2133 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:34.748214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939b11-175d-4946-a5b8-4ffdea2e2133 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:34.749594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 634/1261] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:56:34.754635 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c111f-59ea-45aa-8bdd-a443a120b002 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:34.755061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c111f-59ea-45aa-8bdd-a443a120b002 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:34.755197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c111f-59ea-45aa-8bdd-a443a120b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:34.771490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-154c111f-59ea-45aa-8bdd-a443a120b002 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:56:34.772686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-154c111f-59ea-45aa-8bdd-a443a120b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:56:34.836035 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 628/1262] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:56:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:56:34.859459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939b11-175d-4946-a5b8-4ffdea2e2133 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:34.955593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939b11-175d-4946-a5b8-4ffdea2e2133 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:34.987663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca102e-4f02-4163-bc50-a8e0781345a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:34.988458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca102e-4f02-4163-bc50-a8e0781345a7 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:34.988738 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca102e-4f02-4163-bc50-a8e0781345a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:34.989010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca102e-4f02-4163-bc50-a8e0781345a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:34.998685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca102e-4f02-4163-bc50-a8e0781345a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-2dca102e-4f02-4163-bc50-a8e0781345a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:56:35.006240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:35.007312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:35.008356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 635/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:56:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:35.013503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c111f-59ea-45aa-8bdd-a443a120b002 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:35.106162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c111f-59ea-45aa-8bdd-a443a120b002 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:35.137912 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8235f9-c823-491e-bdd8-0fb0d2ba6644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:35.138564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8235f9-c823-491e-bdd8-0fb0d2ba6644 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:35.138844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8235f9-c823-491e-bdd8-0fb0d2ba6644 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:35.139116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8235f9-c823-491e-bdd8-0fb0d2ba6644 None admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:35.139856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8235f9-c823-491e-bdd8-0fb0d2ba6644 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:35.140163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8235f9-c823-491e-bdd8-0fb0d2ba6644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:35.141569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8235f9-c823-491e-bdd8-0fb0d2ba6644 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:35.149225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 629/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:56:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:35.155687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca102e-4f02-4163-bc50-a8e0781345a7 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:35.250000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca102e-4f02-4163-bc50-a8e0781345a7 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:35.280966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146f060-0a47-4ba9-8c72-c641441ff574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:35.281736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146f060-0a47-4ba9-8c72-c641441ff574 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:35.282018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146f060-0a47-4ba9-8c72-c641441ff574 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:35.282291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146f060-0a47-4ba9-8c72-c641441ff574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:35.292675 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146f060-0a47-4ba9-8c72-c641441ff574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:35.294109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146f060-0a47-4ba9-8c72-c641441ff574 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-6146f060-0a47-4ba9-8c72-c641441ff574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:35.311180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:35.312228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:35.313514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:35.313514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:35.313514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:35.313514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:35.313514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 636/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 11:56:35.318194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8235f9-c823-491e-bdd8-0fb0d2ba6644 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:35.412018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8235f9-c823-491e-bdd8-0fb0d2ba6644 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:35.443988 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a1816-30d0-4821-9fd7-2bf5677a701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:35.444654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a1816-30d0-4821-9fd7-2bf5677a701e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:35.444933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a1816-30d0-4821-9fd7-2bf5677a701e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:35.445201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a1816-30d0-4821-9fd7-2bf5677a701e None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:35.445905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a1816-30d0-4821-9fd7-2bf5677a701e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:35.446207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a1816-30d0-4821-9fd7-2bf5677a701e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:35.447555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a1816-30d0-4821-9fd7-2bf5677a701e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:35.458668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 630/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:35.464210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146f060-0a47-4ba9-8c72-c641441ff574 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:35.574840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146f060-0a47-4ba9-8c72-c641441ff574 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:35.605767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92264c-ff69-4214-bcca-e249396afb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:35.606552 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92264c-ff69-4214-bcca-e249396afb16 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:35.606829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92264c-ff69-4214-bcca-e249396afb16 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:35.607099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92264c-ff69-4214-bcca-e249396afb16 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:35.614107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92264c-ff69-4214-bcca-e249396afb16 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:35.615535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92264c-ff69-4214-bcca-e249396afb16 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-cb92264c-ff69-4214-bcca-e249396afb16 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:56:35.629817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:35.630878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:35.632136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:35.632136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:35.632136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:56:35.632136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:56:35.632136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:56:35.632136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:56:35.632136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:56:35.632136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:56:35.632136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:35.632136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:35.632136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 637/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:35.637607 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a1816-30d0-4821-9fd7-2bf5677a701e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:35.729490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a1816-30d0-4821-9fd7-2bf5677a701e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:35.760733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cab505-31e6-4877-8c16-37c1120d8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:35.761474 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab505-31e6-4877-8c16-37c1120d8392 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:35.761765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab505-31e6-4877-8c16-37c1120d8392 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:35.762037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab505-31e6-4877-8c16-37c1120d8392 None admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:35.762855 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cab505-31e6-4877-8c16-37c1120d8392 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:35.763162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cab505-31e6-4877-8c16-37c1120d8392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:35.764591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cab505-31e6-4877-8c16-37c1120d8392 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:35.781254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 631/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Tue May 17 11:56:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:35.786606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92264c-ff69-4214-bcca-e249396afb16 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:35.880454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92264c-ff69-4214-bcca-e249396afb16 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:35.911999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51ea1e-1da5-4ad8-ab87-c979e5b6d3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:35.912799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51ea1e-1da5-4ad8-ab87-c979e5b6d3e0 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:35.913079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51ea1e-1da5-4ad8-ab87-c979e5b6d3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:35.913350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51ea1e-1da5-4ad8-ab87-c979e5b6d3e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:35.923181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51ea1e-1da5-4ad8-ab87-c979e5b6d3e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:35.924642 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51ea1e-1da5-4ad8-ab87-c979e5b6d3e0 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-3b51ea1e-1da5-4ad8-ab87-c979e5b6d3e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:35.940981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:35.941901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:35.942969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:35.942969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:35.942969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:35.942969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:35.942969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 638/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:35.947692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cab505-31e6-4877-8c16-37c1120d8392 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:36.041217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cab505-31e6-4877-8c16-37c1120d8392 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:36.072033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570c0d9-d5a0-49a9-8744-4bbd15a2dce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:36.072701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570c0d9-d5a0-49a9-8744-4bbd15a2dce9 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:36.072980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570c0d9-d5a0-49a9-8744-4bbd15a2dce9 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:36.073252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570c0d9-d5a0-49a9-8744-4bbd15a2dce9 None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:36.074468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570c0d9-d5a0-49a9-8744-4bbd15a2dce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:36.074766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570c0d9-d5a0-49a9-8744-4bbd15a2dce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:36.076105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570c0d9-d5a0-49a9-8744-4bbd15a2dce9 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:36.086606 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 632/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:36.092671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51ea1e-1da5-4ad8-ab87-c979e5b6d3e0 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:36.186388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51ea1e-1da5-4ad8-ab87-c979e5b6d3e0 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:36.218395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78266e-8790-457a-8138-b30b1a99b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:36.219158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78266e-8790-457a-8138-b30b1a99b500 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:36.219437 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78266e-8790-457a-8138-b30b1a99b500 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:36.219708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78266e-8790-457a-8138-b30b1a99b500 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:36.226006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78266e-8790-457a-8138-b30b1a99b500 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:36.227450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78266e-8790-457a-8138-b30b1a99b500 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-fe78266e-8790-457a-8138-b30b1a99b500 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:56:36.241063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:36.242060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:36.242995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:56:36.242995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:56:36.242995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:56:36.242995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:56:36.242995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:56:36.242995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:56:36.242995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:36.242995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:36.242995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 639/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:56:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:36.248052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570c0d9-d5a0-49a9-8744-4bbd15a2dce9 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:36.341399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570c0d9-d5a0-49a9-8744-4bbd15a2dce9 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:36.372853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76930400-adf6-41c8-b611-ae2521d0eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:36.373487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76930400-adf6-41c8-b611-ae2521d0eb96 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:36.373766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76930400-adf6-41c8-b611-ae2521d0eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:36.374038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76930400-adf6-41c8-b611-ae2521d0eb96 None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:36.374808 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76930400-adf6-41c8-b611-ae2521d0eb96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:36.375114 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76930400-adf6-41c8-b611-ae2521d0eb96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:36.376557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76930400-adf6-41c8-b611-ae2521d0eb96 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:36.388483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 633/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:56:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:36.394408 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78266e-8790-457a-8138-b30b1a99b500 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:36.490331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78266e-8790-457a-8138-b30b1a99b500 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:36.526043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd4c03-f9b3-40fd-9bee-50c2e3e2690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:36.527053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd4c03-f9b3-40fd-9bee-50c2e3e2690c None admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:36.527410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd4c03-f9b3-40fd-9bee-50c2e3e2690c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:36.527684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd4c03-f9b3-40fd-9bee-50c2e3e2690c None admin] PATH_INFO: `/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/c5222a62941948229324ec8c073caf86/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:36.529630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd4c03-f9b3-40fd-9bee-50c2e3e2690c None admin] RBAC: Authorizing `identity:create_grant(project_id=9c3eefc2606b4ee988e14ac7e11f90ef, user_id=c5222a62941948229324ec8c073caf86, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:36.531063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd4c03-f9b3-40fd-9bee-50c2e3e2690c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:36.543382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 640/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Tue May 17 11:56:36 2022] PUT /identity/v3/projects/9c3eefc2606b4ee988e14ac7e11f90ef/users/c5222a62941948229324ec8c073caf86/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 11:56:38.711414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c9443-b1f7-44e7-acb3-383fbfa639bc None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:38.711967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c9443-b1f7-44e7-acb3-383fbfa639bc None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:38.711967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c9443-b1f7-44e7-acb3-383fbfa639bc None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:38.713338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 634/1274] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:56:38.719199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb1995-daa3-4a71-93a2-a1808532ffaa None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:38.719636 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb1995-daa3-4a71-93a2-a1808532ffaa None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:38.719736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb1995-daa3-4a71-93a2-a1808532ffaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:38.736433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-9eeb1995-daa3-4a71-93a2-a1808532ffaa None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:56:38.737593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9eeb1995-daa3-4a71-93a2-a1808532ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:56:38.799008 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 641/1275] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:56:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:56:38.821913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c9443-b1f7-44e7-acb3-383fbfa639bc None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:38.918148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c9443-b1f7-44e7-acb3-383fbfa639bc None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:38.951253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbc814-7051-4f09-b47f-0362ed85174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:38.952019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc814-7051-4f09-b47f-0362ed85174c None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:38.952328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc814-7051-4f09-b47f-0362ed85174c None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:38.952602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc814-7051-4f09-b47f-0362ed85174c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:38.962131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbc814-7051-4f09-b47f-0362ed85174c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-3cfbc814-7051-4f09-b47f-0362ed85174c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 11:56:38.970190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:38.971252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:38.972326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 635/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Tue May 17 11:56:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:38.977687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb1995-daa3-4a71-93a2-a1808532ffaa None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:39.071249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb1995-daa3-4a71-93a2-a1808532ffaa None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:39.102114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52776d-1619-4a29-b3a6-00d67e3cab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:39.102766 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52776d-1619-4a29-b3a6-00d67e3cab25 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:39.103045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52776d-1619-4a29-b3a6-00d67e3cab25 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:39.103319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52776d-1619-4a29-b3a6-00d67e3cab25 None admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:39.104054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52776d-1619-4a29-b3a6-00d67e3cab25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:39.104386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52776d-1619-4a29-b3a6-00d67e3cab25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:39.106263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52776d-1619-4a29-b3a6-00d67e3cab25 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:39.113774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 642/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Tue May 17 11:56:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:56:39.119503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbc814-7051-4f09-b47f-0362ed85174c None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:39.213358 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbc814-7051-4f09-b47f-0362ed85174c None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:39.244715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b21b8-f9c9-4bf5-b0e0-4f12dd383d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:39.246069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b21b8-f9c9-4bf5-b0e0-4f12dd383d27 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:39.246346 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b21b8-f9c9-4bf5-b0e0-4f12dd383d27 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:39.246619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b21b8-f9c9-4bf5-b0e0-4f12dd383d27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:39.256502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b21b8-f9c9-4bf5-b0e0-4f12dd383d27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:39.257952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b21b8-f9c9-4bf5-b0e0-4f12dd383d27 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-e72b21b8-f9c9-4bf5-b0e0-4f12dd383d27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:39.274058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:39.275046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:39.275963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:39.275963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:39.275963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:39.275963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:39.275963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 636/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:39.281661 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52776d-1619-4a29-b3a6-00d67e3cab25 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:39.375658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52776d-1619-4a29-b3a6-00d67e3cab25 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:39.407318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc914e-74a6-41f5-9e58-e365e6ca76cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:39.407970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc914e-74a6-41f5-9e58-e365e6ca76cb None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:39.408282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc914e-74a6-41f5-9e58-e365e6ca76cb None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:39.408563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc914e-74a6-41f5-9e58-e365e6ca76cb None admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:39.409278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc914e-74a6-41f5-9e58-e365e6ca76cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:39.409587 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc914e-74a6-41f5-9e58-e365e6ca76cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:39.410952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc914e-74a6-41f5-9e58-e365e6ca76cb None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:39.422714 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 643/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:39.428401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b21b8-f9c9-4bf5-b0e0-4f12dd383d27 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:39.536776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b21b8-f9c9-4bf5-b0e0-4f12dd383d27 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:39.569649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0108916-0243-40f8-95e6-2e942dfd6bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:39.570436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0108916-0243-40f8-95e6-2e942dfd6bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:39.570714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0108916-0243-40f8-95e6-2e942dfd6bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:39.570986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0108916-0243-40f8-95e6-2e942dfd6bd0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:39.578775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0108916-0243-40f8-95e6-2e942dfd6bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:39.580223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0108916-0243-40f8-95e6-2e942dfd6bd0 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-d0108916-0243-40f8-95e6-2e942dfd6bd0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 11:56:39.593901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:39.594924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:39.595925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:39.595925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:39.595925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 11:56:39.595925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 11:56:39.595925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 11:56:39.595925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 11:56:39.595925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 11:56:39.595925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 11:56:39.595925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 11:56:39.595925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:39.595925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 637/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:39.601120 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc914e-74a6-41f5-9e58-e365e6ca76cb None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:39.695995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc914e-74a6-41f5-9e58-e365e6ca76cb None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:39.728034 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6b4da-ca26-47ab-a1a6-ebc0a5e2240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:39.728726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b4da-ca26-47ab-a1a6-ebc0a5e2240a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:39.729009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b4da-ca26-47ab-a1a6-ebc0a5e2240a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:39.729285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b4da-ca26-47ab-a1a6-ebc0a5e2240a None admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:39.730614 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6b4da-ca26-47ab-a1a6-ebc0a5e2240a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:39.731130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6b4da-ca26-47ab-a1a6-ebc0a5e2240a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:39.732602 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6b4da-ca26-47ab-a1a6-ebc0a5e2240a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:39.749299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 644/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Tue May 17 11:56:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:39.754914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0108916-0243-40f8-95e6-2e942dfd6bd0 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:39.848418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0108916-0243-40f8-95e6-2e942dfd6bd0 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:39.880220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd78579-d356-46c7-abe3-3bd6f6e4833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:39.880856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd78579-d356-46c7-abe3-3bd6f6e4833e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:39.881141 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd78579-d356-46c7-abe3-3bd6f6e4833e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:39.881419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd78579-d356-46c7-abe3-3bd6f6e4833e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:39.944723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd78579-d356-46c7-abe3-3bd6f6e4833e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:39.946202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd78579-d356-46c7-abe3-3bd6f6e4833e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:40.037785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 638/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Tue May 17 11:56:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 11:56:40.044113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6b4da-ca26-47ab-a1a6-ebc0a5e2240a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:40.137498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6b4da-ca26-47ab-a1a6-ebc0a5e2240a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:40.170313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820939b7-f47c-4d7c-abe4-77731cc6eb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:40.171092 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820939b7-f47c-4d7c-abe4-77731cc6eb4a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:40.171379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820939b7-f47c-4d7c-abe4-77731cc6eb4a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:40.171655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820939b7-f47c-4d7c-abe4-77731cc6eb4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:40.181243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820939b7-f47c-4d7c-abe4-77731cc6eb4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:40.182684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820939b7-f47c-4d7c-abe4-77731cc6eb4a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-820939b7-f47c-4d7c-abe4-77731cc6eb4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 11:56:40.200043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:40.201109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:40.202210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 11:56:40.202210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 11:56:40.202210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 11:56:40.202210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:40.202210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 645/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 11:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:40.206882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd78579-d356-46c7-abe3-3bd6f6e4833e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:40.299595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd78579-d356-46c7-abe3-3bd6f6e4833e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:40.331095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76529e5f-6aaf-4dc5-8061-dd473e35216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:40.331740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76529e5f-6aaf-4dc5-8061-dd473e35216f None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:40.332020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76529e5f-6aaf-4dc5-8061-dd473e35216f None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:40.332336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76529e5f-6aaf-4dc5-8061-dd473e35216f None admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:40.333054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76529e5f-6aaf-4dc5-8061-dd473e35216f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:40.333361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76529e5f-6aaf-4dc5-8061-dd473e35216f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:40.334718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76529e5f-6aaf-4dc5-8061-dd473e35216f None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:40.347176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 639/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Tue May 17 11:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:40.352687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820939b7-f47c-4d7c-abe4-77731cc6eb4a None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:40.446853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820939b7-f47c-4d7c-abe4-77731cc6eb4a None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:40.479725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4abd-f216-4aaf-b11d-58a2bf223155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:40.480615 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4abd-f216-4aaf-b11d-58a2bf223155 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:40.480898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4abd-f216-4aaf-b11d-58a2bf223155 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:40.481153 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4abd-f216-4aaf-b11d-58a2bf223155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:40.488064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c4abd-f216-4aaf-b11d-58a2bf223155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:40.489524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c4abd-f216-4aaf-b11d-58a2bf223155 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application [None req-b73c4abd-f216-4aaf-b11d-58a2bf223155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 11:56:40.502884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application with Lock( May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:40.503779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:40.504863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 11:56:40.504863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 11:56:40.504863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 11:56:40.504863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 11:56:40.504863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 11:56:40.504863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 11:56:40.504863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 11:56:40.504863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: ERROR keystone.server.flask.application May 17 11:56:40.504863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 646/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Tue May 17 11:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:40.509819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76529e5f-6aaf-4dc5-8061-dd473e35216f None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:40.604454 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76529e5f-6aaf-4dc5-8061-dd473e35216f None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:40.635993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a954f9f-c181-4e9f-b130-23ecfefa156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:40.637192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954f9f-c181-4e9f-b130-23ecfefa156e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:40.637613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954f9f-c181-4e9f-b130-23ecfefa156e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:40.637891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a954f9f-c181-4e9f-b130-23ecfefa156e None admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:40.638661 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a954f9f-c181-4e9f-b130-23ecfefa156e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:40.638969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a954f9f-c181-4e9f-b130-23ecfefa156e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:40.640405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a954f9f-c181-4e9f-b130-23ecfefa156e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:40.651628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 640/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Tue May 17 11:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:40.658321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4abd-f216-4aaf-b11d-58a2bf223155 None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:40.751076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4abd-f216-4aaf-b11d-58a2bf223155 None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:40.782506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081729a-5481-42dd-b89c-03723e04ae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:40.783132 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081729a-5481-42dd-b89c-03723e04ae94 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:40.783418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081729a-5481-42dd-b89c-03723e04ae94 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:40.783741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081729a-5481-42dd-b89c-03723e04ae94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:40.784519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081729a-5481-42dd-b89c-03723e04ae94 None admin] RBAC: Adding query filter params (role.id=3db33dfd3d6544fd81933007633fc56a, scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef, user.id=c5222a62941948229324ec8c073caf86) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:40.784826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081729a-5481-42dd-b89c-03723e04ae94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:40.786241 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081729a-5481-42dd-b89c-03723e04ae94 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:40.791722 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 647/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Tue May 17 11:56:40 2022] GET /identity/v3/role_assignments?user.id=c5222a62941948229324ec8c073caf86&scope.project.id=9c3eefc2606b4ee988e14ac7e11f90ef&role.id=3db33dfd3d6544fd81933007633fc56a => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:56:43.011622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4942dfe-e8dd-4165-ba4c-02de4580d961 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:43.012310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4942dfe-e8dd-4165-ba4c-02de4580d961 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:43.012310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4942dfe-e8dd-4165-ba4c-02de4580d961 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:43.013528 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 641/1288] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:56:43.018657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7fc7e-47c5-4570-b333-b1cb63f9317a None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:43.019025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7fc7e-47c5-4570-b333-b1cb63f9317a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:43.019225 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7fc7e-47c5-4570-b333-b1cb63f9317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:43.035906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-99f7fc7e-47c5-4570-b333-b1cb63f9317a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:56:43.037107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-99f7fc7e-47c5-4570-b333-b1cb63f9317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:56:43.100128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 648/1289] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:56:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:56:43.122649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4942dfe-e8dd-4165-ba4c-02de4580d961 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:43.218400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4942dfe-e8dd-4165-ba4c-02de4580d961 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:43.250182 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81153cd3-b0bb-4943-81cd-3850ab46180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:43.250966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153cd3-b0bb-4943-81cd-3850ab46180e None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:43.251247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153cd3-b0bb-4943-81cd-3850ab46180e None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:43.251520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153cd3-b0bb-4943-81cd-3850ab46180e None admin] PATH_INFO: `/v3/services/placement` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:43.252170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81153cd3-b0bb-4943-81cd-3850ab46180e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:43.253550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81153cd3-b0bb-4943-81cd-3850ab46180e None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-81153cd3-b0bb-4943-81cd-3850ab46180e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:43.265294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:43.266515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:43.267511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 642/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Tue May 17 11:56:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:43.272358 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7fc7e-47c5-4570-b333-b1cb63f9317a None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:43.365459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7fc7e-47c5-4570-b333-b1cb63f9317a None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:43.397985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f795af8-d516-49d4-86af-14da1fd92b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:43.398632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f795af8-d516-49d4-86af-14da1fd92b86 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:43.398913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f795af8-d516-49d4-86af-14da1fd92b86 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:43.399186 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f795af8-d516-49d4-86af-14da1fd92b86 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:43.399883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f795af8-d516-49d4-86af-14da1fd92b86 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:43.400210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f795af8-d516-49d4-86af-14da1fd92b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:43.401565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f795af8-d516-49d4-86af-14da1fd92b86 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:43.406747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 649/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Tue May 17 11:56:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:43.412325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81153cd3-b0bb-4943-81cd-3850ab46180e None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:43.509442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81153cd3-b0bb-4943-81cd-3850ab46180e None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:43.548386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3e6c9-dd3e-489f-a329-9bd774096748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:43.549044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3e6c9-dd3e-489f-a329-9bd774096748 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:43.549346 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3e6c9-dd3e-489f-a329-9bd774096748 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:43.549590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3e6c9-dd3e-489f-a329-9bd774096748 None admin] PATH_INFO: `/v3/services` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:43.550330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3e6c9-dd3e-489f-a329-9bd774096748 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:43.550594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3e6c9-dd3e-489f-a329-9bd774096748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:43.551949 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3e6c9-dd3e-489f-a329-9bd774096748 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:43.556369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 643/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Tue May 17 11:56:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:45.726950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f496a27-6f93-498d-8b66-d5ce7c84be16 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:45.727541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f496a27-6f93-498d-8b66-d5ce7c84be16 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:45.727541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f496a27-6f93-498d-8b66-d5ce7c84be16 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:45.728885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 650/1293] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:56:45.734465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3742a-c80d-4973-9c15-b1837ff6443b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:45.734898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3742a-c80d-4973-9c15-b1837ff6443b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:45.735031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3742a-c80d-4973-9c15-b1837ff6443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:45.752003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-66b3742a-c80d-4973-9c15-b1837ff6443b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:56:45.753210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-66b3742a-c80d-4973-9c15-b1837ff6443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:56:45.816218 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 644/1294] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:56:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:56:45.838256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f496a27-6f93-498d-8b66-d5ce7c84be16 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:45.932748 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f496a27-6f93-498d-8b66-d5ce7c84be16 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:45.964551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e85504-3068-4d06-bfca-78cb879d6103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:45.965191 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e85504-3068-4d06-bfca-78cb879d6103 None admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:45.965469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e85504-3068-4d06-bfca-78cb879d6103 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:45.965746 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e85504-3068-4d06-bfca-78cb879d6103 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:45.966455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e85504-3068-4d06-bfca-78cb879d6103 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:45.967805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e85504-3068-4d06-bfca-78cb879d6103 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:45.980909 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 651/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Tue May 17 11:56:45 2022] POST /identity/v3/services => generated 246 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:56:48.170472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da27dbb-bf5a-4fb2-a240-5044f235ea88 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:48.171024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da27dbb-bf5a-4fb2-a240-5044f235ea88 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:48.171024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da27dbb-bf5a-4fb2-a240-5044f235ea88 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:48.172409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 645/1296] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:56:48.177631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa087e9-4f15-44b5-9feb-c4f6a1e1974c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:48.178022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa087e9-4f15-44b5-9feb-c4f6a1e1974c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:48.178184 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa087e9-4f15-44b5-9feb-c4f6a1e1974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:48.194540 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-baa087e9-4f15-44b5-9feb-c4f6a1e1974c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:56:48.195692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-baa087e9-4f15-44b5-9feb-c4f6a1e1974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:56:48.264096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 652/1297] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:56:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 11:56:48.286896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da27dbb-bf5a-4fb2-a240-5044f235ea88 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:48.382285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da27dbb-bf5a-4fb2-a240-5044f235ea88 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:48.415028 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9422def-a7ef-49da-bc1c-8a466930ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:48.415806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9422def-a7ef-49da-bc1c-8a466930ec8b None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:48.416087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9422def-a7ef-49da-bc1c-8a466930ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:48.416385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9422def-a7ef-49da-bc1c-8a466930ec8b None admin] PATH_INFO: `/v3/services/placement` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:48.417035 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9422def-a7ef-49da-bc1c-8a466930ec8b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:48.418436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9422def-a7ef-49da-bc1c-8a466930ec8b None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-d9422def-a7ef-49da-bc1c-8a466930ec8b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:48.430456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:48.431589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:48.432439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 646/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Tue May 17 11:56:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:48.438463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa087e9-4f15-44b5-9feb-c4f6a1e1974c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:48.532858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa087e9-4f15-44b5-9feb-c4f6a1e1974c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:48.565464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363b657-3374-4b64-bd64-26dfbc5e033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:48.566122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363b657-3374-4b64-bd64-26dfbc5e033c None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:48.566400 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363b657-3374-4b64-bd64-26dfbc5e033c None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:48.566669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363b657-3374-4b64-bd64-26dfbc5e033c None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:48.567362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363b657-3374-4b64-bd64-26dfbc5e033c None admin] RBAC: Adding query filter params (name=placement) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:48.567662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363b657-3374-4b64-bd64-26dfbc5e033c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:48.569044 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363b657-3374-4b64-bd64-26dfbc5e033c None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:48.574515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 653/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Tue May 17 11:56:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 11:56:48.580404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9422def-a7ef-49da-bc1c-8a466930ec8b None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:48.672559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9422def-a7ef-49da-bc1c-8a466930ec8b None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:48.703807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39a72-486e-4429-8db2-187bbe26a6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:48.704404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39a72-486e-4429-8db2-187bbe26a6c8 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:48.704685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39a72-486e-4429-8db2-187bbe26a6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:48.704965 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39a72-486e-4429-8db2-187bbe26a6c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:48.705734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac39a72-486e-4429-8db2-187bbe26a6c8 None admin] RBAC: Adding query filter params (interface=public, service_id=9b5892db55e745c9914f9fb69ca01f0d, region_id=RegionOne) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:48.706040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac39a72-486e-4429-8db2-187bbe26a6c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:48.707382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac39a72-486e-4429-8db2-187bbe26a6c8 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:48.712078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 647/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Tue May 17 11:56:48 2022] GET /identity/v3/endpoints?service_id=9b5892db55e745c9914f9fb69ca01f0d&interface=public®ion_id=RegionOne => generated 194 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:48.717527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363b657-3374-4b64-bd64-26dfbc5e033c None admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:48.810899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363b657-3374-4b64-bd64-26dfbc5e033c None admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:48.842001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1696d-2ed1-4e92-a66c-b924a915439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:48.842635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1696d-2ed1-4e92-a66c-b924a915439a None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:48.842913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1696d-2ed1-4e92-a66c-b924a915439a None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:48.843180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1696d-2ed1-4e92-a66c-b924a915439a None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:48.843849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1696d-2ed1-4e92-a66c-b924a915439a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:48.845225 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1696d-2ed1-4e92-a66c-b924a915439a None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:48.851687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 654/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Tue May 17 11:56:48 2022] GET /identity/v3/services => generated 2191 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 11:56:51.029412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb109dae-3340-40c4-8417-2f483a40aae7 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:51.029963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb109dae-3340-40c4-8417-2f483a40aae7 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:51.029963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb109dae-3340-40c4-8417-2f483a40aae7 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:51.031346 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 648/1302] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:56:51.036418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375264f-afcf-4d33-9ab5-5671fc750d3e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:51.036823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375264f-afcf-4d33-9ab5-5671fc750d3e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:51.036966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375264f-afcf-4d33-9ab5-5671fc750d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:51.052954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-0375264f-afcf-4d33-9ab5-5671fc750d3e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:56:51.054103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0375264f-afcf-4d33-9ab5-5671fc750d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:56:51.116092 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 655/1303] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:56:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 11:56:51.139310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb109dae-3340-40c4-8417-2f483a40aae7 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:51.235641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb109dae-3340-40c4-8417-2f483a40aae7 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:51.267108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee127d8a-d3e1-42dd-8201-802d768180c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:51.267886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee127d8a-d3e1-42dd-8201-802d768180c1 None admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:51.268166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee127d8a-d3e1-42dd-8201-802d768180c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:51.268476 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee127d8a-d3e1-42dd-8201-802d768180c1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:51.269117 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee127d8a-d3e1-42dd-8201-802d768180c1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:51.270467 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee127d8a-d3e1-42dd-8201-802d768180c1 None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application [None req-ee127d8a-d3e1-42dd-8201-802d768180c1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 11:56:51.282834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 11:56:51.283941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.get_or_create( May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application with Lock( May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self._enter() May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application return self.creator() May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application created_value = creator( May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: ERROR keystone.server.flask.application May 17 11:56:51.284888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 649/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Tue May 17 11:56:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 11:56:51.289957 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375264f-afcf-4d33-9ab5-5671fc750d3e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:51.382490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375264f-afcf-4d33-9ab5-5671fc750d3e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:51.414849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf9464-a6a9-48f6-87af-234c0f638010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:51.415485 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9464-a6a9-48f6-87af-234c0f638010 None admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:51.415763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9464-a6a9-48f6-87af-234c0f638010 None admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:51.416033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf9464-a6a9-48f6-87af-234c0f638010 None admin] PATH_INFO: `/v3/services` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:51.416750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf9464-a6a9-48f6-87af-234c0f638010 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 11:56:51.417052 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf9464-a6a9-48f6-87af-234c0f638010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:51.418521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf9464-a6a9-48f6-87af-234c0f638010 None admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:51.423398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 656/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Tue May 17 11:56:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 11:56:51.429020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee127d8a-d3e1-42dd-8201-802d768180c1 None admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:56:51.524151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee127d8a-d3e1-42dd-8201-802d768180c1 None admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:56:51.555888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fe5c5-040f-4689-8b83-c4a8b0237f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:56:51.556511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe5c5-040f-4689-8b83-c4a8b0237f5d None admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:56:51.556796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe5c5-040f-4689-8b83-c4a8b0237f5d None admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:56:51.557076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fe5c5-040f-4689-8b83-c4a8b0237f5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:56:51.557818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fe5c5-040f-4689-8b83-c4a8b0237f5d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:56:51.559706 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fe5c5-040f-4689-8b83-c4a8b0237f5d None admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:56:51.578010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 650/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Tue May 17 11:56:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 11:57:54.949861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6e844-443b-41e0-b8c5-e6551d600d68 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:57:54.951441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6e844-443b-41e0-b8c5-e6551d600d68 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:57:54.951975 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6e844-443b-41e0-b8c5-e6551d600d68 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:57:54.953620 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 657/1307] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:57:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:57:54.959357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba264-f1d2-4671-81ae-927aaaf3eb3b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:57:54.960242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba264-f1d2-4671-81ae-927aaaf3eb3b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:57:54.960754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba264-f1d2-4671-81ae-927aaaf3eb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:57:55.048063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-75aba264-f1d2-4671-81ae-927aaaf3eb3b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:57:55.049657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-75aba264-f1d2-4671-81ae-927aaaf3eb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:57:55.280796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 651/1308] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:57:55.317512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd8079-3a88-4e4f-94d5-288184fa0ef7 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:57:55.317795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd8079-3a88-4e4f-94d5-288184fa0ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:57:55.318429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd8079-3a88-4e4f-94d5-288184fa0ef7 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:57:55.321523 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 658/1309] 10.222.0.58 () {54 vars in 964 bytes} [Tue May 17 11:57:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:57:55.330545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017a594-f202-49e0-b6a8-7927b638b39b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:57:55.330831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017a594-f202-49e0-b6a8-7927b638b39b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:57:55.331813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017a594-f202-49e0-b6a8-7927b638b39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:57:55.411271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a017a594-f202-49e0-b6a8-7927b638b39b None None] MFA Rules not processed for user `95029e6140de425e86b5f9d7e2923bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:57:55.412998 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a017a594-f202-49e0-b6a8-7927b638b39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:57:55.490957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 652/1310] 10.222.0.58 () {58 vars in 1061 bytes} [Tue May 17 11:57:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:57:55.501188 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd8079-3a88-4e4f-94d5-288184fa0ef7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:57:55.503113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e7cd8079-3a88-4e4f-94d5-288184fa0ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:57:55.615899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd8079-3a88-4e4f-94d5-288184fa0ef7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:57:55.689855 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4f2a8-e084-49c6-a90d-7bd1d1637a51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:57:55.690506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4f2a8-e084-49c6-a90d-7bd1d1637a51 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:57:55.690802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4f2a8-e084-49c6-a90d-7bd1d1637a51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:57:55.691079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4f2a8-e084-49c6-a90d-7bd1d1637a51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:57:55.692742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9fc4f2a8-e084-49c6-a90d-7bd1d1637a51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:57:55.804657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4f2a8-e084-49c6-a90d-7bd1d1637a51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:57:55.806123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4f2a8-e084-49c6-a90d-7bd1d1637a51 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:57:55.826348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 659/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:57:58.359290 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8606bd9-4dde-4e4e-a164-4d5003ae8610 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:57:58.359802 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8606bd9-4dde-4e4e-a164-4d5003ae8610 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:57:58.359922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8606bd9-4dde-4e4e-a164-4d5003ae8610 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:57:58.361304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 653/1312] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:57:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:57:58.368556 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f316e-26f3-480f-9a20-b55299c51de1 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:57:58.369071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f316e-26f3-480f-9a20-b55299c51de1 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:57:58.369166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f316e-26f3-480f-9a20-b55299c51de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:57:58.458013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-6e6f316e-26f3-480f-9a20-b55299c51de1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:57:58.459337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6e6f316e-26f3-480f-9a20-b55299c51de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:57:58.559523 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 660/1313] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 11:57:58.614695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1de8-b9a5-4f48-87a8-1ceb9c1b820e None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:57:58.614980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1de8-b9a5-4f48-87a8-1ceb9c1b820e None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:57:58.615464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1de8-b9a5-4f48-87a8-1ceb9c1b820e None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:57:58.616949 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 654/1314] 10.222.0.58 () {54 vars in 964 bytes} [Tue May 17 11:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:57:58.624044 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3233fc-995a-4b5a-8052-cae46269857e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:57:58.624360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3233fc-995a-4b5a-8052-cae46269857e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:57:58.624641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3233fc-995a-4b5a-8052-cae46269857e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:57:58.700312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-6b3233fc-995a-4b5a-8052-cae46269857e None None] MFA Rules not processed for user `95029e6140de425e86b5f9d7e2923bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:57:58.702328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6b3233fc-995a-4b5a-8052-cae46269857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:57:58.775885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 661/1315] 10.222.0.58 () {58 vars in 1061 bytes} [Tue May 17 11:57:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:57:58.785427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d1de8-b9a5-4f48-87a8-1ceb9c1b820e None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:57:58.786947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f00d1de8-b9a5-4f48-87a8-1ceb9c1b820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:57:58.890977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d1de8-b9a5-4f48-87a8-1ceb9c1b820e None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:57:58.968053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3db3e-98e2-4114-8d05-1ff0fad46b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:57:58.968964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3db3e-98e2-4114-8d05-1ff0fad46b23 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:57:58.969405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3db3e-98e2-4114-8d05-1ff0fad46b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:57:58.969858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3db3e-98e2-4114-8d05-1ff0fad46b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:57:58.971764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-15a3db3e-98e2-4114-8d05-1ff0fad46b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:57:59.085773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3db3e-98e2-4114-8d05-1ff0fad46b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:57:59.087451 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3db3e-98e2-4114-8d05-1ff0fad46b23 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:57:59.108964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 655/1316] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:01.967861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff9f89-0e1a-460c-88fb-427a0cbf7ae7 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:01.968480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff9f89-0e1a-460c-88fb-427a0cbf7ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:01.968480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff9f89-0e1a-460c-88fb-427a0cbf7ae7 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:01.969809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 662/1317] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:01.975041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d527a3-259f-4684-be2b-09129dae3338 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:01.975460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d527a3-259f-4684-be2b-09129dae3338 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:01.975622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d527a3-259f-4684-be2b-09129dae3338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:02.052382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-57d527a3-259f-4684-be2b-09129dae3338 None None] MFA Rules not processed for user `a8842ef81bce467bbeb3e3cf1f632151`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:02.053625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-57d527a3-259f-4684-be2b-09129dae3338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:02.146007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 656/1318] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:02.185487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff9f89-0e1a-460c-88fb-427a0cbf7ae7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:02.186987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-32ff9f89-0e1a-460c-88fb-427a0cbf7ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:02.287035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff9f89-0e1a-460c-88fb-427a0cbf7ae7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:02.358698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedc5e0-66d8-49e4-9ead-5f039d892cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:02.359347 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedc5e0-66d8-49e4-9ead-5f039d892cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:02.359634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedc5e0-66d8-49e4-9ead-5f039d892cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:02.359916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedc5e0-66d8-49e4-9ead-5f039d892cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:02.361592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-fbedc5e0-66d8-49e4-9ead-5f039d892cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:02.466389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedc5e0-66d8-49e4-9ead-5f039d892cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:02.467825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedc5e0-66d8-49e4-9ead-5f039d892cc2 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:02.485971 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 663/1319] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:05.249045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d61ff-ec57-4ccd-9e34-4892c8ac9fba None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:05.249564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d61ff-ec57-4ccd-9e34-4892c8ac9fba None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:05.249564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d61ff-ec57-4ccd-9e34-4892c8ac9fba None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:05.250880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 657/1320] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:05.256035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19af64-8b3f-44bf-82f8-2bd5903569d0 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:05.256498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19af64-8b3f-44bf-82f8-2bd5903569d0 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:05.256626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19af64-8b3f-44bf-82f8-2bd5903569d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:05.319582 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ef19af64-8b3f-44bf-82f8-2bd5903569d0 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:05.320799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ef19af64-8b3f-44bf-82f8-2bd5903569d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:05.413888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 664/1321] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:05.453097 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d61ff-ec57-4ccd-9e34-4892c8ac9fba None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:05.454624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-af1d61ff-ec57-4ccd-9e34-4892c8ac9fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:05.557881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d61ff-ec57-4ccd-9e34-4892c8ac9fba None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:05.628061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893e282-3239-4b64-8022-6f0146729d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:05.628727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893e282-3239-4b64-8022-6f0146729d7c service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:05.629011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893e282-3239-4b64-8022-6f0146729d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:05.629289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893e282-3239-4b64-8022-6f0146729d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:05.630919 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4893e282-3239-4b64-8022-6f0146729d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:05.749831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893e282-3239-4b64-8022-6f0146729d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:05.751265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893e282-3239-4b64-8022-6f0146729d7c service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:05.770413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 658/1322] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:08.632330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca1a3-71da-41a0-89fe-5aefe9030c03 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:08.632883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca1a3-71da-41a0-89fe-5aefe9030c03 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:08.632883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ca1a3-71da-41a0-89fe-5aefe9030c03 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:08.634240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 665/1323] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:08.639502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9788-cebc-446f-bbe5-3bdd09c1fd23 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:08.639890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9788-cebc-446f-bbe5-3bdd09c1fd23 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:08.640172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d9788-cebc-446f-bbe5-3bdd09c1fd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:08.702965 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-908d9788-cebc-446f-bbe5-3bdd09c1fd23 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:08.704152 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-908d9788-cebc-446f-bbe5-3bdd09c1fd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:08.798922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 659/1324] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:08.834487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca1a3-71da-41a0-89fe-5aefe9030c03 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:08.836016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ee5ca1a3-71da-41a0-89fe-5aefe9030c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:08.939071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ca1a3-71da-41a0-89fe-5aefe9030c03 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:09.010746 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3769c-a8d4-4310-82d3-d92dfe391644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:09.011399 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3769c-a8d4-4310-82d3-d92dfe391644 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:09.011681 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3769c-a8d4-4310-82d3-d92dfe391644 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:09.011954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3769c-a8d4-4310-82d3-d92dfe391644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:09.013639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7af3769c-a8d4-4310-82d3-d92dfe391644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:09.120827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3769c-a8d4-4310-82d3-d92dfe391644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:09.122189 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3769c-a8d4-4310-82d3-d92dfe391644 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:09.140118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 666/1325] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 11:58:11.430415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8880f-8563-42eb-bc59-6ad7fd7cc6e1 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:11.430964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8880f-8563-42eb-bc59-6ad7fd7cc6e1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:11.430964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8880f-8563-42eb-bc59-6ad7fd7cc6e1 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:11.432357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 660/1326] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:11.438725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c663c-9a92-4c95-bf6f-b7ea4dc79760 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:11.439189 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c663c-9a92-4c95-bf6f-b7ea4dc79760 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:11.439294 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c663c-9a92-4c95-bf6f-b7ea4dc79760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:11.503881 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-0a9c663c-9a92-4c95-bf6f-b7ea4dc79760 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:11.505152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0a9c663c-9a92-4c95-bf6f-b7ea4dc79760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:11.602664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 667/1327] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:11.638338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8880f-8563-42eb-bc59-6ad7fd7cc6e1 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:11.639862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-26a8880f-8563-42eb-bc59-6ad7fd7cc6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:11.741836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8880f-8563-42eb-bc59-6ad7fd7cc6e1 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:11.813010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda4cba-c467-4954-8a2a-d4cc530a2cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:11.813912 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4cba-c467-4954-8a2a-d4cc530a2cda service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:11.814194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4cba-c467-4954-8a2a-d4cc530a2cda service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:11.814469 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4cba-c467-4954-8a2a-d4cc530a2cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:11.816095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ddda4cba-c467-4954-8a2a-d4cc530a2cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:11.924051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda4cba-c467-4954-8a2a-d4cc530a2cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:11.925515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda4cba-c467-4954-8a2a-d4cc530a2cda service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:11.943207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 661/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:14.229455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ee97-4650-4e70-92d6-4ce0993de20d None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:14.230024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ee97-4650-4e70-92d6-4ce0993de20d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:14.230024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ee97-4650-4e70-92d6-4ce0993de20d None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:14.231366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 668/1329] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:14.237234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ba182-c4d2-4192-83b8-0d4735075bc6 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:14.237651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ba182-c4d2-4192-83b8-0d4735075bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:14.237928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ba182-c4d2-4192-83b8-0d4735075bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:14.302728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-bd8ba182-c4d2-4192-83b8-0d4735075bc6 None None] MFA Rules not processed for user `a8842ef81bce467bbeb3e3cf1f632151`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:14.303941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-bd8ba182-c4d2-4192-83b8-0d4735075bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:14.398884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 662/1330] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:14.436689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635ee97-4650-4e70-92d6-4ce0993de20d None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:14.438234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a635ee97-4650-4e70-92d6-4ce0993de20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:14.540416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635ee97-4650-4e70-92d6-4ce0993de20d None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:14.613435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f86b2a-c756-4bac-9d2e-cdd7ad8d3c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:14.614086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f86b2a-c756-4bac-9d2e-cdd7ad8d3c1c service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:14.614364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f86b2a-c756-4bac-9d2e-cdd7ad8d3c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:14.614641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f86b2a-c756-4bac-9d2e-cdd7ad8d3c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:14.616278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-41f86b2a-c756-4bac-9d2e-cdd7ad8d3c1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:14.719773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f86b2a-c756-4bac-9d2e-cdd7ad8d3c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:14.721244 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f86b2a-c756-4bac-9d2e-cdd7ad8d3c1c service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:14.738795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 669/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 11:58:17.360065 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45121ab-94eb-4866-a253-4f5833e69eea None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:17.360566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45121ab-94eb-4866-a253-4f5833e69eea None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:17.360681 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45121ab-94eb-4866-a253-4f5833e69eea None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:17.362021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 663/1332] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:17.367550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4e5bb-2d25-45aa-bd06-d712e1a22fe4 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:17.368009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4e5bb-2d25-45aa-bd06-d712e1a22fe4 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:17.368110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4e5bb-2d25-45aa-bd06-d712e1a22fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:17.431312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-3aa4e5bb-2d25-45aa-bd06-d712e1a22fe4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:17.432522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3aa4e5bb-2d25-45aa-bd06-d712e1a22fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:17.529476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 670/1333] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:17.564850 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45121ab-94eb-4866-a253-4f5833e69eea None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:17.566365 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f45121ab-94eb-4866-a253-4f5833e69eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:17.669631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45121ab-94eb-4866-a253-4f5833e69eea None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:17.740553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3f600-626f-4675-bb06-b861205aa09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:17.741121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3f600-626f-4675-bb06-b861205aa09b service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:17.741400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3f600-626f-4675-bb06-b861205aa09b service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:17.741672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3f600-626f-4675-bb06-b861205aa09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:17.743271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-cbf3f600-626f-4675-bb06-b861205aa09b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:17.850452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3f600-626f-4675-bb06-b861205aa09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:17.851672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3f600-626f-4675-bb06-b861205aa09b service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:17.879474 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 664/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:20.137526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989206b0-64f2-4807-bf1b-399873e36fb5 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:20.138377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989206b0-64f2-4807-bf1b-399873e36fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:20.138377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989206b0-64f2-4807-bf1b-399873e36fb5 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:20.139491 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 671/1335] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:20.144681 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d90104-a1b7-48fc-bcf7-d0df3e50048f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:20.145088 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d90104-a1b7-48fc-bcf7-d0df3e50048f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:20.145247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d90104-a1b7-48fc-bcf7-d0df3e50048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:20.207825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-99d90104-a1b7-48fc-bcf7-d0df3e50048f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:20.209043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-99d90104-a1b7-48fc-bcf7-d0df3e50048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:20.302017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 665/1336] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 11:58:20.342154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989206b0-64f2-4807-bf1b-399873e36fb5 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:20.343691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-989206b0-64f2-4807-bf1b-399873e36fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:20.443909 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989206b0-64f2-4807-bf1b-399873e36fb5 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:20.512838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c48ff-e6e3-4aa9-875c-da5ae77390f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:20.513518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c48ff-e6e3-4aa9-875c-da5ae77390f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:20.513801 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c48ff-e6e3-4aa9-875c-da5ae77390f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:20.514078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c48ff-e6e3-4aa9-875c-da5ae77390f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:20.515705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-860c48ff-e6e3-4aa9-875c-da5ae77390f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:20.620053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c48ff-e6e3-4aa9-875c-da5ae77390f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:20.621449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c48ff-e6e3-4aa9-875c-da5ae77390f4 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:20.638725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 672/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:23.183149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e07b-f5fd-438e-9c4a-223aaa9e5d45 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:23.183672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e07b-f5fd-438e-9c4a-223aaa9e5d45 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:23.183765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e07b-f5fd-438e-9c4a-223aaa9e5d45 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:23.185356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 666/1338] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:23.190542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad0004-9f96-49aa-9370-7858a7020f14 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:23.190947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad0004-9f96-49aa-9370-7858a7020f14 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:23.191096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad0004-9f96-49aa-9370-7858a7020f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:23.253733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-5bad0004-9f96-49aa-9370-7858a7020f14 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:23.254873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5bad0004-9f96-49aa-9370-7858a7020f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:23.347692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 673/1339] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:23.382812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95e07b-f5fd-438e-9c4a-223aaa9e5d45 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:23.384356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1c95e07b-f5fd-438e-9c4a-223aaa9e5d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:23.485058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95e07b-f5fd-438e-9c4a-223aaa9e5d45 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:23.557696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781165e7-7e06-414e-933a-a00b5c03fea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:23.558350 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781165e7-7e06-414e-933a-a00b5c03fea2 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:23.558627 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781165e7-7e06-414e-933a-a00b5c03fea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:23.558898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781165e7-7e06-414e-933a-a00b5c03fea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:23.561249 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-781165e7-7e06-414e-933a-a00b5c03fea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:23.666663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781165e7-7e06-414e-933a-a00b5c03fea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:23.668103 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781165e7-7e06-414e-933a-a00b5c03fea2 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:23.686762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 667/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:27.971456 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61130cde-8d45-4592-9dd4-7a22dc97b766 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:27.971965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61130cde-8d45-4592-9dd4-7a22dc97b766 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:27.971965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61130cde-8d45-4592-9dd4-7a22dc97b766 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:27.973328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 674/1341] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:27.979059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98ccc7-2c47-4830-b55e-4717cc9721d0 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:27.979465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98ccc7-2c47-4830-b55e-4717cc9721d0 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:27.979668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98ccc7-2c47-4830-b55e-4717cc9721d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:28.046924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-9f98ccc7-2c47-4830-b55e-4717cc9721d0 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:28.048087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9f98ccc7-2c47-4830-b55e-4717cc9721d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:28.148738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 668/1342] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:28.186903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61130cde-8d45-4592-9dd4-7a22dc97b766 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:28.189315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-61130cde-8d45-4592-9dd4-7a22dc97b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:28.287640 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61130cde-8d45-4592-9dd4-7a22dc97b766 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:28.291563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24e8a2-75fd-4801-a3c0-695675ea7cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:28.292236 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24e8a2-75fd-4801-a3c0-695675ea7cca service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:28.292515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24e8a2-75fd-4801-a3c0-695675ea7cca service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:28.292790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24e8a2-75fd-4801-a3c0-695675ea7cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:28.302650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24e8a2-75fd-4801-a3c0-695675ea7cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:28.304078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24e8a2-75fd-4801-a3c0-695675ea7cca service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:28.313862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 675/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:31.202257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334eecb-fb25-4e39-96c0-bf74fdfe20f1 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:31.202852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334eecb-fb25-4e39-96c0-bf74fdfe20f1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:31.202951 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334eecb-fb25-4e39-96c0-bf74fdfe20f1 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:31.204305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 669/1344] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:31.209524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc7ffb-8174-464e-8b4c-cb7aabb7a8b3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:31.210003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc7ffb-8174-464e-8b4c-cb7aabb7a8b3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:31.210227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc7ffb-8174-464e-8b4c-cb7aabb7a8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:31.239147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f4fc7ffb-8174-464e-8b4c-cb7aabb7a8b3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:31.240366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f4fc7ffb-8174-464e-8b4c-cb7aabb7a8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:31.314116 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 676/1345] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:31.351018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334eecb-fb25-4e39-96c0-bf74fdfe20f1 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:31.361876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334eecb-fb25-4e39-96c0-bf74fdfe20f1 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:31.365345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1b7db-b1be-4d9f-870f-39924cd6faea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:31.365980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1b7db-b1be-4d9f-870f-39924cd6faea service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:31.366261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1b7db-b1be-4d9f-870f-39924cd6faea service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:31.366560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1b7db-b1be-4d9f-870f-39924cd6faea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:31.375458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1b7db-b1be-4d9f-870f-39924cd6faea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:31.376924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1b7db-b1be-4d9f-870f-39924cd6faea service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:31.386258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 670/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:35.542379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b70024-65cc-4ee0-a1d0-fc870d23f43a None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:35.542837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b70024-65cc-4ee0-a1d0-fc870d23f43a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:35.543027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b70024-65cc-4ee0-a1d0-fc870d23f43a None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:35.545174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 677/1347] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:35.551056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65d5ca-103d-4fd9-8d2a-cac683229d71 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:35.551512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65d5ca-103d-4fd9-8d2a-cac683229d71 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:35.551606 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65d5ca-103d-4fd9-8d2a-cac683229d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:35.569582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-9d65d5ca-103d-4fd9-8d2a-cac683229d71 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:35.570754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9d65d5ca-103d-4fd9-8d2a-cac683229d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:35.578832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 671/1348] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:35.616522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b70024-65cc-4ee0-a1d0-fc870d23f43a None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:35.627220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b70024-65cc-4ee0-a1d0-fc870d23f43a None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:35.630854 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a4073-70d3-41e6-bc8c-02322498f935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:35.631497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4073-70d3-41e6-bc8c-02322498f935 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:35.631779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4073-70d3-41e6-bc8c-02322498f935 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:35.632053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a4073-70d3-41e6-bc8c-02322498f935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:35.641618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a4073-70d3-41e6-bc8c-02322498f935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:35.643036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a4073-70d3-41e6-bc8c-02322498f935 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:35.652056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 678/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:41.055759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d38544-453e-4f55-a294-b0456cd6bcca None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:41.056279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d38544-453e-4f55-a294-b0456cd6bcca None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:41.057315 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d38544-453e-4f55-a294-b0456cd6bcca None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:41.060074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 672/1350] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 11:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:41.065835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9060-19e5-49f8-a358-51f9de61f172 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:41.066651 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9060-19e5-49f8-a358-51f9de61f172 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:41.067098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9060-19e5-49f8-a358-51f9de61f172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:41.177493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c44d9060-19e5-49f8-a358-51f9de61f172 None None] MFA Rules not processed for user `c5222a62941948229324ec8c073caf86`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:41.178966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c44d9060-19e5-49f8-a358-51f9de61f172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:41.290168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 679/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 11:58:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 11:58:45.353569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a1e5b-42bd-4731-8890-680711ea7138 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:45.354107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a1e5b-42bd-4731-8890-680711ea7138 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:45.354376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a1e5b-42bd-4731-8890-680711ea7138 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:45.355932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 673/1352] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 11:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:45.361860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc9c20-9c92-41e6-8730-b39b7895ba28 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:45.362297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc9c20-9c92-41e6-8730-b39b7895ba28 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:45.362626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc9c20-9c92-41e6-8730-b39b7895ba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:45.382526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-96cc9c20-9c92-41e6-8730-b39b7895ba28 None None] MFA Rules not processed for user `c5222a62941948229324ec8c073caf86`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:45.383815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-96cc9c20-9c92-41e6-8730-b39b7895ba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:45.393846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 680/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 11:58:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:47.194084 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe8fe7-8e7c-4c75-bb83-f334c7537d23 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:47.194607 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe8fe7-8e7c-4c75-bb83-f334c7537d23 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:47.194699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe8fe7-8e7c-4c75-bb83-f334c7537d23 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:47.195996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 674/1354] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 11:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:47.201482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353ec20-1cdc-4fbc-a5e5-2d0a9258a6af None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:47.201899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353ec20-1cdc-4fbc-a5e5-2d0a9258a6af None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:47.202174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353ec20-1cdc-4fbc-a5e5-2d0a9258a6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:47.220726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c353ec20-1cdc-4fbc-a5e5-2d0a9258a6af None None] MFA Rules not processed for user `c5222a62941948229324ec8c073caf86`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:47.221981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c353ec20-1cdc-4fbc-a5e5-2d0a9258a6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:47.230509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 681/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 11:58:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 11:58:50.925446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32ae16-0ed1-4eac-8901-be145af0c5d9 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:50.925977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32ae16-0ed1-4eac-8901-be145af0c5d9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:50.925977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32ae16-0ed1-4eac-8901-be145af0c5d9 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:50.927316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 675/1356] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:58:50.932487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031442bd-5a5d-4bda-bff5-b85bde7a751d None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:50.932894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031442bd-5a5d-4bda-bff5-b85bde7a751d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:50.933036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031442bd-5a5d-4bda-bff5-b85bde7a751d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:50.951702 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-031442bd-5a5d-4bda-bff5-b85bde7a751d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:50.953199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-031442bd-5a5d-4bda-bff5-b85bde7a751d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:50.980099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 682/1357] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:51.014032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470b5a-32e6-4d44-b3d9-bad12e423a8d None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:51.014404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470b5a-32e6-4d44-b3d9-bad12e423a8d None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:51.014757 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470b5a-32e6-4d44-b3d9-bad12e423a8d None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:51.016292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 676/1358] 10.222.0.58 () {54 vars in 961 bytes} [Tue May 17 11:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:51.022154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ff26-651f-4b84-8fe7-73d772ba16f7 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:51.022154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ff26-651f-4b84-8fe7-73d772ba16f7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:51.022533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1ff26-651f-4b84-8fe7-73d772ba16f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:51.073278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7bc1ff26-651f-4b84-8fe7-73d772ba16f7 None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:51.074466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7bc1ff26-651f-4b84-8fe7-73d772ba16f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:51.154960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 683/1359] 10.222.0.58 () {58 vars in 1058 bytes} [Tue May 17 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 11:58:51.161963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470b5a-32e6-4d44-b3d9-bad12e423a8d None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:51.176861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470b5a-32e6-4d44-b3d9-bad12e423a8d None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:51.182395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10135673-eca8-4851-8111-1ac5e2ecc69d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:51.183105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10135673-eca8-4851-8111-1ac5e2ecc69d service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:51.183499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10135673-eca8-4851-8111-1ac5e2ecc69d service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:51.183842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10135673-eca8-4851-8111-1ac5e2ecc69d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:51.192900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10135673-eca8-4851-8111-1ac5e2ecc69d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:51.194562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10135673-eca8-4851-8111-1ac5e2ecc69d service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:51.203923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 677/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:53.658624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76bc3a-d495-48ee-94dd-1ad34d51cf04 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:53.659156 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76bc3a-d495-48ee-94dd-1ad34d51cf04 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:53.659261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76bc3a-d495-48ee-94dd-1ad34d51cf04 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:53.660587 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 684/1361] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:53.666051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a8cc-68ad-44b6-94aa-26281acf44f4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:53.666458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a8cc-68ad-44b6-94aa-26281acf44f4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:53.666614 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a8cc-68ad-44b6-94aa-26281acf44f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:53.686592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-cbf6a8cc-68ad-44b6-94aa-26281acf44f4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:53.687788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-cbf6a8cc-68ad-44b6-94aa-26281acf44f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:53.696313 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 678/1362] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:53.741116 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76bc3a-d495-48ee-94dd-1ad34d51cf04 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:53.756362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76bc3a-d495-48ee-94dd-1ad34d51cf04 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:53.762060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf436f-04cc-4978-9c53-3ddbe3f4b66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:53.762942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf436f-04cc-4978-9c53-3ddbe3f4b66e service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:53.763339 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf436f-04cc-4978-9c53-3ddbe3f4b66e service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:53.763726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf436f-04cc-4978-9c53-3ddbe3f4b66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:53.772293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf436f-04cc-4978-9c53-3ddbe3f4b66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:53.774095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf436f-04cc-4978-9c53-3ddbe3f4b66e service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:53.784450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 685/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 11:58:56.327412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022d7ed-89a6-49c2-9793-32e4a5e3c167 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:56.327961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022d7ed-89a6-49c2-9793-32e4a5e3c167 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:56.327961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022d7ed-89a6-49c2-9793-32e4a5e3c167 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:56.329382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 679/1364] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:56.334885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6636930-5c78-43d0-92d5-d5d6e3a62cad None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:56.335732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6636930-5c78-43d0-92d5-d5d6e3a62cad None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:56.336370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6636930-5c78-43d0-92d5-d5d6e3a62cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:56.356568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-e6636930-5c78-43d0-92d5-d5d6e3a62cad None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:56.357770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e6636930-5c78-43d0-92d5-d5d6e3a62cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:56.365668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 686/1365] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:56.411992 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824f482-5d00-405d-aa02-5db078d5cbc5 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:56.412421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824f482-5d00-405d-aa02-5db078d5cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:56.412893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824f482-5d00-405d-aa02-5db078d5cbc5 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:56.414524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 680/1366] 10.222.0.58 () {54 vars in 961 bytes} [Tue May 17 11:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:56.421770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafd5cf-6289-4711-a1c3-4a7253fe4ac2 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:56.422059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafd5cf-6289-4711-a1c3-4a7253fe4ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:56.422348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafd5cf-6289-4711-a1c3-4a7253fe4ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:56.451207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1dafd5cf-6289-4711-a1c3-4a7253fe4ac2 None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:56.452735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1dafd5cf-6289-4711-a1c3-4a7253fe4ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:56.461961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 687/1367] 10.222.0.58 () {58 vars in 1058 bytes} [Tue May 17 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:56.471097 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824f482-5d00-405d-aa02-5db078d5cbc5 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:56.487159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824f482-5d00-405d-aa02-5db078d5cbc5 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:56.492873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6bbf5-dbaf-4c0a-9c0d-984844b5a264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:56.493509 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6bbf5-dbaf-4c0a-9c0d-984844b5a264 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:56.493789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6bbf5-dbaf-4c0a-9c0d-984844b5a264 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:56.494062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6bbf5-dbaf-4c0a-9c0d-984844b5a264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:56.502518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6bbf5-dbaf-4c0a-9c0d-984844b5a264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:56.504094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6bbf5-dbaf-4c0a-9c0d-984844b5a264 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:56.513295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 681/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:58.851396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df9e36-e9be-4bfc-9ae4-4cf8708ae418 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:58.851983 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df9e36-e9be-4bfc-9ae4-4cf8708ae418 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:58.851983 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df9e36-e9be-4bfc-9ae4-4cf8708ae418 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:58.853737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 688/1369] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:58.858977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34243cf-d3b7-40dd-aada-6487ec34bddf None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:58.859425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34243cf-d3b7-40dd-aada-6487ec34bddf None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:58.859528 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34243cf-d3b7-40dd-aada-6487ec34bddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:58.879312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e34243cf-d3b7-40dd-aada-6487ec34bddf None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:58.880548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e34243cf-d3b7-40dd-aada-6487ec34bddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:58.889560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 682/1370] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:58.933083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df9e36-e9be-4bfc-9ae4-4cf8708ae418 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:58.948415 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df9e36-e9be-4bfc-9ae4-4cf8708ae418 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:58.954414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d238bf-46d1-4cf4-8fc1-abe5002010d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:58.955063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d238bf-46d1-4cf4-8fc1-abe5002010d5 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:58.955348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d238bf-46d1-4cf4-8fc1-abe5002010d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:58.955624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d238bf-46d1-4cf4-8fc1-abe5002010d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:58.964191 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d238bf-46d1-4cf4-8fc1-abe5002010d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:58.966117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d238bf-46d1-4cf4-8fc1-abe5002010d5 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:58.977767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 689/1371] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:58:59.175012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f48f-6f6a-4c38-a790-4aadaba02b1f None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:59.175304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f48f-6f6a-4c38-a790-4aadaba02b1f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:59.175743 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f48f-6f6a-4c38-a790-4aadaba02b1f None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:59.177397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 683/1372] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:59.183723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194f46-2cf7-4f00-9403-041a0b98a613 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:59.184896 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194f46-2cf7-4f00-9403-041a0b98a613 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:59.185359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac194f46-2cf7-4f00-9403-041a0b98a613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:59.207659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ac194f46-2cf7-4f00-9403-041a0b98a613 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:59.209266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ac194f46-2cf7-4f00-9403-041a0b98a613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:59.218215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 690/1373] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:59.538768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93906f2-6802-4dcb-9a27-57df18e96a51 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:59.540555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93906f2-6802-4dcb-9a27-57df18e96a51 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:59.541082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93906f2-6802-4dcb-9a27-57df18e96a51 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:59.542816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 684/1374] 10.222.0.58 () {54 vars in 963 bytes} [Tue May 17 11:58:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:58:59.548913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a183cf-18fa-4927-971f-d18301e81aef None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:59.549209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a183cf-18fa-4927-971f-d18301e81aef None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:59.549510 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a183cf-18fa-4927-971f-d18301e81aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:59.599274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-04a183cf-18fa-4927-971f-d18301e81aef None None] MFA Rules not processed for user `1b14c0c2f0cd4459915dbbe3b5939159`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:58:59.600555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-04a183cf-18fa-4927-971f-d18301e81aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:58:59.668444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 691/1375] 10.222.0.58 () {58 vars in 1060 bytes} [Tue May 17 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:58:59.671403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93906f2-6802-4dcb-9a27-57df18e96a51 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:58:59.683193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93906f2-6802-4dcb-9a27-57df18e96a51 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:58:59.687470 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f23ba-966c-47c0-ad9b-6a511b048e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:58:59.688105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f23ba-966c-47c0-ad9b-6a511b048e0f service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:58:59.688512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f23ba-966c-47c0-ad9b-6a511b048e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:58:59.689045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f23ba-966c-47c0-ad9b-6a511b048e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:58:59.698143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f23ba-966c-47c0-ad9b-6a511b048e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:58:59.700213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f23ba-966c-47c0-ad9b-6a511b048e0f service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:58:59.709853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 685/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:01.292704 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d0b3f-a17c-4e5f-9f2e-e64d71ad5476 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:01.293401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d0b3f-a17c-4e5f-9f2e-e64d71ad5476 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:01.293401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d0b3f-a17c-4e5f-9f2e-e64d71ad5476 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:01.295303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 692/1377] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:01.301477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727866-ddfc-4131-8380-25e8e5d2ee90 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:01.302036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727866-ddfc-4131-8380-25e8e5d2ee90 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:01.302036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727866-ddfc-4131-8380-25e8e5d2ee90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:01.320818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-1b727866-ddfc-4131-8380-25e8e5d2ee90 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:01.322078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1b727866-ddfc-4131-8380-25e8e5d2ee90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:01.332575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 686/1378] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:01.379776 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d0b3f-a17c-4e5f-9f2e-e64d71ad5476 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:01.395577 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d0b3f-a17c-4e5f-9f2e-e64d71ad5476 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:01.401584 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b455e-640a-40cc-ad6f-555eaa62d73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:01.402412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b455e-640a-40cc-ad6f-555eaa62d73f service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:01.403557 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b455e-640a-40cc-ad6f-555eaa62d73f service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:01.404355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b455e-640a-40cc-ad6f-555eaa62d73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:01.414006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b455e-640a-40cc-ad6f-555eaa62d73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:01.415645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b455e-640a-40cc-ad6f-555eaa62d73f service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:01.428030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 693/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:03.722800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e6e9b-7755-4ba4-aa3c-f4d855636c56 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:03.723366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e6e9b-7755-4ba4-aa3c-f4d855636c56 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:03.723366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e6e9b-7755-4ba4-aa3c-f4d855636c56 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:03.724733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 687/1380] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:03.730093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f916803-c5e8-430d-92cc-986d91bc326c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:03.730566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f916803-c5e8-430d-92cc-986d91bc326c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:03.730698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f916803-c5e8-430d-92cc-986d91bc326c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:03.748217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7f916803-c5e8-430d-92cc-986d91bc326c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:03.749447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7f916803-c5e8-430d-92cc-986d91bc326c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:03.757149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 694/1381] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:03.801914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e6e9b-7755-4ba4-aa3c-f4d855636c56 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:03.817558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e6e9b-7755-4ba4-aa3c-f4d855636c56 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:03.823157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184f2a5-e893-4fd3-bfce-7695db4bc481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:03.823900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f2a5-e893-4fd3-bfce-7695db4bc481 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:03.824437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f2a5-e893-4fd3-bfce-7695db4bc481 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:03.825270 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184f2a5-e893-4fd3-bfce-7695db4bc481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:03.833947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184f2a5-e893-4fd3-bfce-7695db4bc481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:03.835609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184f2a5-e893-4fd3-bfce-7695db4bc481 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:03.846495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 688/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:06.128974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde80ea-0268-4dc6-b2cc-530b3bd33bff None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:06.129544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde80ea-0268-4dc6-b2cc-530b3bd33bff None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:06.129544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde80ea-0268-4dc6-b2cc-530b3bd33bff None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:06.131362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 695/1383] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:06.137829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cbc8d-b377-4bd4-afc7-9a21f1fa3976 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:06.138487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cbc8d-b377-4bd4-afc7-9a21f1fa3976 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:06.138592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cbc8d-b377-4bd4-afc7-9a21f1fa3976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:06.158815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f87cbc8d-b377-4bd4-afc7-9a21f1fa3976 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:06.160048 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f87cbc8d-b377-4bd4-afc7-9a21f1fa3976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:06.168142 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 689/1384] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:06.210454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde80ea-0268-4dc6-b2cc-530b3bd33bff None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:06.227197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde80ea-0268-4dc6-b2cc-530b3bd33bff None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:06.234257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f056394-b0e1-41e6-9149-6201e059027b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:06.235148 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f056394-b0e1-41e6-9149-6201e059027b service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:06.235440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f056394-b0e1-41e6-9149-6201e059027b service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:06.235720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f056394-b0e1-41e6-9149-6201e059027b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:06.244823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f056394-b0e1-41e6-9149-6201e059027b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:06.247523 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f056394-b0e1-41e6-9149-6201e059027b service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:06.257770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 696/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 11:59:08.757368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d1f30-b867-42e2-91f9-7f2513733443 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:08.758019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d1f30-b867-42e2-91f9-7f2513733443 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:08.758159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d1f30-b867-42e2-91f9-7f2513733443 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:08.759830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 690/1386] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:08.766678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b78cea-379c-4f66-b592-33a95735118d None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:08.767150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b78cea-379c-4f66-b592-33a95735118d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:08.767328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b78cea-379c-4f66-b592-33a95735118d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:08.787545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c2b78cea-379c-4f66-b592-33a95735118d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:08.788881 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c2b78cea-379c-4f66-b592-33a95735118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:08.798146 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 697/1387] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:08.843634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d1f30-b867-42e2-91f9-7f2513733443 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:08.861632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d1f30-b867-42e2-91f9-7f2513733443 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:08.868843 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3aec41-fc76-43e5-8218-c1b4fe8a23dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:08.869912 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aec41-fc76-43e5-8218-c1b4fe8a23dd service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:08.870555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aec41-fc76-43e5-8218-c1b4fe8a23dd service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:08.870980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aec41-fc76-43e5-8218-c1b4fe8a23dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:08.881378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3aec41-fc76-43e5-8218-c1b4fe8a23dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:08.883456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3aec41-fc76-43e5-8218-c1b4fe8a23dd service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:08.895960 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 691/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:11.183401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09097fb-9d39-4e94-b702-3cf303e31041 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:11.184093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09097fb-9d39-4e94-b702-3cf303e31041 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:11.184093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09097fb-9d39-4e94-b702-3cf303e31041 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:11.186247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 698/1389] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:59:11.192419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8685e3-8b3a-4673-a217-0336c8c1705c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:11.192869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8685e3-8b3a-4673-a217-0336c8c1705c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:11.193214 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8685e3-8b3a-4673-a217-0336c8c1705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:11.215688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ee8685e3-8b3a-4673-a217-0336c8c1705c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:11.217384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ee8685e3-8b3a-4673-a217-0336c8c1705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:11.227466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 692/1390] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:11.272132 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09097fb-9d39-4e94-b702-3cf303e31041 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:11.287277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09097fb-9d39-4e94-b702-3cf303e31041 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:11.292849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e0fb7-78a0-400d-9c62-1762062987fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:11.293442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e0fb7-78a0-400d-9c62-1762062987fc service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:11.293725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e0fb7-78a0-400d-9c62-1762062987fc service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:11.294009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e0fb7-78a0-400d-9c62-1762062987fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:11.302883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e0fb7-78a0-400d-9c62-1762062987fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:11.304506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e0fb7-78a0-400d-9c62-1762062987fc service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:11.314705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 699/1391] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:13.740759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c159bf-ddbc-491b-b1d5-622a75449552 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:13.741373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c159bf-ddbc-491b-b1d5-622a75449552 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:13.741373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c159bf-ddbc-491b-b1d5-622a75449552 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:13.742680 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 693/1392] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:13.748334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b3be-6558-444d-aaf9-c6e29b30b220 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:13.748769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b3be-6558-444d-aaf9-c6e29b30b220 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:13.748907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b3be-6558-444d-aaf9-c6e29b30b220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:13.767351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-6b06b3be-6558-444d-aaf9-c6e29b30b220 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:13.768572 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6b06b3be-6558-444d-aaf9-c6e29b30b220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:13.776225 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 700/1393] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:13.819667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c159bf-ddbc-491b-b1d5-622a75449552 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:13.834173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c159bf-ddbc-491b-b1d5-622a75449552 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:13.839429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192b839-59d3-4633-944d-90e4444899e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:13.840064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192b839-59d3-4633-944d-90e4444899e6 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:13.840376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192b839-59d3-4633-944d-90e4444899e6 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:13.840653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192b839-59d3-4633-944d-90e4444899e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:13.849964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192b839-59d3-4633-944d-90e4444899e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:13.851544 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192b839-59d3-4633-944d-90e4444899e6 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:13.861158 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 694/1394] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:15.323551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadfa1e-3d5c-4a98-a7c3-025ca97316ba None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:15.324075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadfa1e-3d5c-4a98-a7c3-025ca97316ba None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:15.324075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadfa1e-3d5c-4a98-a7c3-025ca97316ba None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:15.325428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 701/1395] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:15.330776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f6006-e497-4433-a137-c22bc5b6fd72 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:15.331236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f6006-e497-4433-a137-c22bc5b6fd72 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:15.331340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f6006-e497-4433-a137-c22bc5b6fd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:15.348649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-3a4f6006-e497-4433-a137-c22bc5b6fd72 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:15.349837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-3a4f6006-e497-4433-a137-c22bc5b6fd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:15.358399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 695/1396] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:15.413983 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dd1d3-1414-448f-b4ab-a7d68b6c1358 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:15.414271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dd1d3-1414-448f-b4ab-a7d68b6c1358 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:15.414734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dd1d3-1414-448f-b4ab-a7d68b6c1358 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:15.416121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 702/1397] 10.222.0.58 () {54 vars in 962 bytes} [Tue May 17 11:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:15.421913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b44ca-4fd2-4fec-bedc-959103115754 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:15.422206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b44ca-4fd2-4fec-bedc-959103115754 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:15.422489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b44ca-4fd2-4fec-bedc-959103115754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:15.469483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-917b44ca-4fd2-4fec-bedc-959103115754 None None] MFA Rules not processed for user `767fe573dff349918c26995c206f2155`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:15.470661 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-917b44ca-4fd2-4fec-bedc-959103115754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:15.531794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 696/1398] 10.222.0.58 () {58 vars in 1059 bytes} [Tue May 17 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:15.538374 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dd1d3-1414-448f-b4ab-a7d68b6c1358 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:15.549450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dd1d3-1414-448f-b4ab-a7d68b6c1358 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:15.552882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754b1fa-051f-4566-867b-e7418eb3ac3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767fe573dff349918c26995c206f2155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:15.553517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754b1fa-051f-4566-867b-e7418eb3ac3c service glance] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:15.553796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754b1fa-051f-4566-867b-e7418eb3ac3c service glance] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:15.554068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754b1fa-051f-4566-867b-e7418eb3ac3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:15.562940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754b1fa-051f-4566-867b-e7418eb3ac3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:15.564659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754b1fa-051f-4566-867b-e7418eb3ac3c service glance] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:15.573771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 703/1399] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 11:59:15.995913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afad4d-025c-4add-936f-0a237cf0b606 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:15.996314 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afad4d-025c-4add-936f-0a237cf0b606 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:15.996676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afad4d-025c-4add-936f-0a237cf0b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:16.044705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-d1afad4d-025c-4add-936f-0a237cf0b606 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:16.045916 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d1afad4d-025c-4add-936f-0a237cf0b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:16.108850 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 697/1400] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:16.127364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d4d1-6f54-41fa-9c55-7116a95a0157 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:16.127664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d4d1-6f54-41fa-9c55-7116a95a0157 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:16.127943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290d4d1-6f54-41fa-9c55-7116a95a0157 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:16.129392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 704/1401] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:16.134709 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87e2ed-f860-4135-a56d-2ecfb60dacb4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:16.134989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87e2ed-f860-4135-a56d-2ecfb60dacb4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:16.135277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87e2ed-f860-4135-a56d-2ecfb60dacb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:16.150843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dc3f3-67a0-4abc-a02d-33080151d853 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:16.151133 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dc3f3-67a0-4abc-a02d-33080151d853 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:16.151412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dc3f3-67a0-4abc-a02d-33080151d853 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:16.152866 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 705/1402] 10.222.0.58 () {54 vars in 942 bytes} [Tue May 17 11:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 11:59:16.154457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-2f87e2ed-f860-4135-a56d-2ecfb60dacb4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:16.155650 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2f87e2ed-f860-4135-a56d-2ecfb60dacb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:16.159154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a139a2-8cb1-4d13-b409-f52bde40ba78 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:16.159448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a139a2-8cb1-4d13-b409-f52bde40ba78 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:16.159735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a139a2-8cb1-4d13-b409-f52bde40ba78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:16.163771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 698/1403] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 11:59:16.207409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87e2ed-f860-4135-a56d-2ecfb60dacb4 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:16.209028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-b4a139a2-8cb1-4d13-b409-f52bde40ba78 None None] MFA Rules not processed for user `5206e8bbb04042f4b00637518f297a97`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:16.210206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b4a139a2-8cb1-4d13-b409-f52bde40ba78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:16.219247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87e2ed-f860-4135-a56d-2ecfb60dacb4 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:16.224770 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caecd99-5aa5-4256-88c1-0fb9dcf7cd8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:16.225412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caecd99-5aa5-4256-88c1-0fb9dcf7cd8a service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:16.225722 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caecd99-5aa5-4256-88c1-0fb9dcf7cd8a service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:16.225997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caecd99-5aa5-4256-88c1-0fb9dcf7cd8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:16.234868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caecd99-5aa5-4256-88c1-0fb9dcf7cd8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:16.236502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caecd99-5aa5-4256-88c1-0fb9dcf7cd8a service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:16.245729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 699/1404] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 11:59:16.281095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 706/1405] 10.222.0.58 () {58 vars in 1039 bytes} [Tue May 17 11:59:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 11:59:16.290272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caecd99-5aa5-4256-88c1-0fb9dcf7cd8a service nova] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:16.301390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caecd99-5aa5-4256-88c1-0fb9dcf7cd8a service nova] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:16.307310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab4bc5-5729-4c99-a957-402ec5a6e546 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:16.307942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab4bc5-5729-4c99-a957-402ec5a6e546 service swift] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:16.308248 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab4bc5-5729-4c99-a957-402ec5a6e546 service swift] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:16.308527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab4bc5-5729-4c99-a957-402ec5a6e546 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:16.317478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab4bc5-5729-4c99-a957-402ec5a6e546 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:16.319113 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab4bc5-5729-4c99-a957-402ec5a6e546 service swift] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:16.328119 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 700/1406] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 11:59:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 11:59:18.532912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae6635-a56f-4cd3-a771-38b6eaa024d8 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:18.533835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae6635-a56f-4cd3-a771-38b6eaa024d8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:18.534342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae6635-a56f-4cd3-a771-38b6eaa024d8 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:18.535965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 707/1407] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 11:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:18.541172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42edddd-3d6c-450c-ab9b-f633d9fd0983 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:18.541593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42edddd-3d6c-450c-ab9b-f633d9fd0983 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:18.541704 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42edddd-3d6c-450c-ab9b-f633d9fd0983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:18.563889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e42edddd-3d6c-450c-ab9b-f633d9fd0983 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:18.565477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e42edddd-3d6c-450c-ab9b-f633d9fd0983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:18.573573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 701/1408] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 11:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 11:59:18.617422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae6635-a56f-4cd3-a771-38b6eaa024d8 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:18.633258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae6635-a56f-4cd3-a771-38b6eaa024d8 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:18.639776 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22d7a4-93d1-4af5-a1d6-0cec89ed3e32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:18.640532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22d7a4-93d1-4af5-a1d6-0cec89ed3e32 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:18.640883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22d7a4-93d1-4af5-a1d6-0cec89ed3e32 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:18.641246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22d7a4-93d1-4af5-a1d6-0cec89ed3e32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:18.649590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22d7a4-93d1-4af5-a1d6-0cec89ed3e32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:18.651265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22d7a4-93d1-4af5-a1d6-0cec89ed3e32 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:18.661894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 708/1409] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:40.212692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67666-3734-4684-9f11-4543d93eb384 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:40.213335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67666-3734-4684-9f11-4543d93eb384 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:40.213335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b67666-3734-4684-9f11-4543d93eb384 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:40.214587 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 702/1410] 10.222.0.58 () {54 vars in 918 bytes} [Tue May 17 11:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:40.220463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640184-f63f-457b-baca-518d69d287bf None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:40.220899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640184-f63f-457b-baca-518d69d287bf None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:40.221026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640184-f63f-457b-baca-518d69d287bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:40.239274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-96640184-f63f-457b-baca-518d69d287bf None None] MFA Rules not processed for user `c5222a62941948229324ec8c073caf86`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:40.240489 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-96640184-f63f-457b-baca-518d69d287bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:40.248919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 709/1411] 10.222.0.58 () {58 vars in 1015 bytes} [Tue May 17 11:59:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:40.262819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bdad0-d1de-4f50-b6fb-ead912c13446 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:40.263106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bdad0-d1de-4f50-b6fb-ead912c13446 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:40.263380 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bdad0-d1de-4f50-b6fb-ead912c13446 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:40.264769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 703/1412] 10.222.0.58 () {54 vars in 918 bytes} [Tue May 17 11:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:40.269267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d2d1-d23d-4550-ab9a-cad5bcb4ca2f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:40.269559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d2d1-d23d-4550-ab9a-cad5bcb4ca2f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:40.269836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7d2d1-d23d-4550-ab9a-cad5bcb4ca2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:40.288682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-e7a7d2d1-d23d-4550-ab9a-cad5bcb4ca2f None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:40.289880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e7a7d2d1-d23d-4550-ab9a-cad5bcb4ca2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:40.299461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 710/1413] 10.222.0.58 () {58 vars in 1015 bytes} [Tue May 17 11:59:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 11:59:42.978296 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7293c-61b5-44f5-a6e7-e0611df335cd None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:42.978869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7293c-61b5-44f5-a6e7-e0611df335cd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:42.978869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7293c-61b5-44f5-a6e7-e0611df335cd None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:42.980212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 11:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:42.986222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61352f-ed0e-4e64-a4ac-f95d1174adcd None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:42.986675 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61352f-ed0e-4e64-a4ac-f95d1174adcd None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:42.986875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61352f-ed0e-4e64-a4ac-f95d1174adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:43.005446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-fd61352f-ed0e-4e64-a4ac-f95d1174adcd None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:43.006658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-fd61352f-ed0e-4e64-a4ac-f95d1174adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:43.014925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 11:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:43.056720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7293c-61b5-44f5-a6e7-e0611df335cd None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:43.071227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7293c-61b5-44f5-a6e7-e0611df335cd None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:43.076623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa31d83-284a-4cd8-b202-9965ddbf9489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:43.077258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa31d83-284a-4cd8-b202-9965ddbf9489 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:43.077544 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa31d83-284a-4cd8-b202-9965ddbf9489 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:43.077822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa31d83-284a-4cd8-b202-9965ddbf9489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:43.085707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa31d83-284a-4cd8-b202-9965ddbf9489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:43.087281 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa31d83-284a-4cd8-b202-9965ddbf9489 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:43.097007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 705/1416] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:44.080016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03437ce-b8b8-44d5-b91f-1e47c35e550e None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:44.080630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03437ce-b8b8-44d5-b91f-1e47c35e550e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:44.080630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03437ce-b8b8-44d5-b91f-1e47c35e550e None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:44.081967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 11:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:44.086809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3829a72-4c17-42c3-8b56-4ee1329a74ff None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:44.087251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3829a72-4c17-42c3-8b56-4ee1329a74ff None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:44.087363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3829a72-4c17-42c3-8b56-4ee1329a74ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:44.105509 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-d3829a72-4c17-42c3-8b56-4ee1329a74ff None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:44.107240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d3829a72-4c17-42c3-8b56-4ee1329a74ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:44.115031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 11:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:44.275083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03437ce-b8b8-44d5-b91f-1e47c35e550e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:44.289720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03437ce-b8b8-44d5-b91f-1e47c35e550e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:44.295702 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cedce2-16e1-40c5-8333-3884c97d29a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:44.296614 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cedce2-16e1-40c5-8333-3884c97d29a3 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:44.296935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cedce2-16e1-40c5-8333-3884c97d29a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:44.297209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cedce2-16e1-40c5-8333-3884c97d29a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:44.305629 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cedce2-16e1-40c5-8333-3884c97d29a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:44.307223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cedce2-16e1-40c5-8333-3884c97d29a3 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:44.316966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 713/1419] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:45.260441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8dc4-d2e0-4ccb-8827-c55f4076df70 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:45.260985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8dc4-d2e0-4ccb-8827-c55f4076df70 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:45.260985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8dc4-d2e0-4ccb-8827-c55f4076df70 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:45.263000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 11:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:45.268082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d2ca1-a4a8-415d-aae9-d1735d42513e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:45.268552 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d2ca1-a4a8-415d-aae9-d1735d42513e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:45.268649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d2ca1-a4a8-415d-aae9-d1735d42513e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:45.286625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-604d2ca1-a4a8-415d-aae9-d1735d42513e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:45.287825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-604d2ca1-a4a8-415d-aae9-d1735d42513e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:45.296157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 11:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:45.445705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f8dc4-d2e0-4ccb-8827-c55f4076df70 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:45.460487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f8dc4-d2e0-4ccb-8827-c55f4076df70 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:45.465774 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64487351-1393-4e7c-9680-106beb605270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:45.466425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64487351-1393-4e7c-9680-106beb605270 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:45.466707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64487351-1393-4e7c-9680-106beb605270 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:45.466982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64487351-1393-4e7c-9680-106beb605270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:45.474883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64487351-1393-4e7c-9680-106beb605270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:45.476504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64487351-1393-4e7c-9680-106beb605270 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:45.485627 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 708/1422] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:46.412752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67f3c-c182-4873-95d1-f255ac0599e6 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:46.413386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67f3c-c182-4873-95d1-f255ac0599e6 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:46.413386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b67f3c-c182-4873-95d1-f255ac0599e6 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:46.414666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 11:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:46.419520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab21ce-6e40-482f-b148-67450d454411 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:46.419936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab21ce-6e40-482f-b148-67450d454411 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:46.420125 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab21ce-6e40-482f-b148-67450d454411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:46.437554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-34ab21ce-6e40-482f-b148-67450d454411 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:46.438730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-34ab21ce-6e40-482f-b148-67450d454411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:46.446659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 11:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:46.595955 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b67f3c-c182-4873-95d1-f255ac0599e6 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:46.610203 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b67f3c-c182-4873-95d1-f255ac0599e6 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:46.615496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb93c5d-44aa-45dd-8b52-a2a32cf5a1d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:46.616128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93c5d-44aa-45dd-8b52-a2a32cf5a1d6 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:46.616447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93c5d-44aa-45dd-8b52-a2a32cf5a1d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:46.616725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb93c5d-44aa-45dd-8b52-a2a32cf5a1d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:46.624843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb93c5d-44aa-45dd-8b52-a2a32cf5a1d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:46.626414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb93c5d-44aa-45dd-8b52-a2a32cf5a1d6 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:46.635553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 716/1425] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:47.562992 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613941-cd34-4f9a-a12e-da08cbe21043 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:47.563467 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613941-cd34-4f9a-a12e-da08cbe21043 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:47.563564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44613941-cd34-4f9a-a12e-da08cbe21043 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:47.565207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 11:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:47.570014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa1916-4a09-42f2-9e7a-220e35a47d28 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:47.570471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa1916-4a09-42f2-9e7a-220e35a47d28 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:47.570578 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa1916-4a09-42f2-9e7a-220e35a47d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:47.588676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-bdaa1916-4a09-42f2-9e7a-220e35a47d28 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:47.589857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bdaa1916-4a09-42f2-9e7a-220e35a47d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:47.597632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 11:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:47.747207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44613941-cd34-4f9a-a12e-da08cbe21043 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:47.761106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44613941-cd34-4f9a-a12e-da08cbe21043 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:47.767121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58508970-7c5e-43c2-bbf6-43a72d2e5adf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:47.767749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58508970-7c5e-43c2-bbf6-43a72d2e5adf service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:47.768029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58508970-7c5e-43c2-bbf6-43a72d2e5adf service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:47.768336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58508970-7c5e-43c2-bbf6-43a72d2e5adf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:47.776215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58508970-7c5e-43c2-bbf6-43a72d2e5adf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:47.777865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58508970-7c5e-43c2-bbf6-43a72d2e5adf service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:47.786870 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 711/1428] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:48.682084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3070ab1-50cd-406e-84ee-f193ff82d01d None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:48.682658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3070ab1-50cd-406e-84ee-f193ff82d01d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:48.682658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3070ab1-50cd-406e-84ee-f193ff82d01d None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:48.684001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 11:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:48.689921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19da60-f508-48f9-9f53-be80e8a98f00 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:48.690376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19da60-f508-48f9-9f53-be80e8a98f00 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:48.690492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19da60-f508-48f9-9f53-be80e8a98f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:48.707881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-0c19da60-f508-48f9-9f53-be80e8a98f00 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:48.709102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0c19da60-f508-48f9-9f53-be80e8a98f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:48.716826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 11:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:48.865305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3070ab1-50cd-406e-84ee-f193ff82d01d None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:48.879756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3070ab1-50cd-406e-84ee-f193ff82d01d None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:48.885136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafe650-8b67-48c9-8fb1-4b40108c5f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:48.885769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafe650-8b67-48c9-8fb1-4b40108c5f2c service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:48.886052 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafe650-8b67-48c9-8fb1-4b40108c5f2c service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:48.886323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafe650-8b67-48c9-8fb1-4b40108c5f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:48.894263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafe650-8b67-48c9-8fb1-4b40108c5f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:48.895835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafe650-8b67-48c9-8fb1-4b40108c5f2c service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:48.905038 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 719/1431] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 11:59:49.771475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d08498-87d7-440b-ab01-fd6bc65084dd None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:49.772031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d08498-87d7-440b-ab01-fd6bc65084dd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:49.772031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d08498-87d7-440b-ab01-fd6bc65084dd None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:49.773416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 11:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:49.778884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce13d-46b8-4adc-ada8-7ccfe8320fcd None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:49.779284 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce13d-46b8-4adc-ada8-7ccfe8320fcd None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:49.779513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce13d-46b8-4adc-ada8-7ccfe8320fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:49.797496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-3fbce13d-46b8-4adc-ada8-7ccfe8320fcd None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:49.798660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3fbce13d-46b8-4adc-ada8-7ccfe8320fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:49.806280 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 11:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:49.957785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d08498-87d7-440b-ab01-fd6bc65084dd None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:49.971620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d08498-87d7-440b-ab01-fd6bc65084dd None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:49.976970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fac82-5dda-4e6e-84b4-4e4ebfc722cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:49.977605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fac82-5dda-4e6e-84b4-4e4ebfc722cf service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:49.977880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fac82-5dda-4e6e-84b4-4e4ebfc722cf service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:49.978151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fac82-5dda-4e6e-84b4-4e4ebfc722cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:49.986123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fac82-5dda-4e6e-84b4-4e4ebfc722cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:49.987696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fac82-5dda-4e6e-84b4-4e4ebfc722cf service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:49.997434 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 714/1434] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:50.874123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed0ab-f64d-4d30-9432-1cf759e5c1c7 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:50.874648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed0ab-f64d-4d30-9432-1cf759e5c1c7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:50.874648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed0ab-f64d-4d30-9432-1cf759e5c1c7 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:50.875978 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 11:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:50.880982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c2222-2b86-4b94-a17d-b23ce3be1e51 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:50.881431 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c2222-2b86-4b94-a17d-b23ce3be1e51 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:50.881525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c2222-2b86-4b94-a17d-b23ce3be1e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:50.899054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-fe5c2222-2b86-4b94-a17d-b23ce3be1e51 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:50.900262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-fe5c2222-2b86-4b94-a17d-b23ce3be1e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:50.908037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 11:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:51.057191 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed0ab-f64d-4d30-9432-1cf759e5c1c7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:51.072459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed0ab-f64d-4d30-9432-1cf759e5c1c7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:51.078059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e2d88-8bed-421a-92ca-411919ecf2a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:51.078688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e2d88-8bed-421a-92ca-411919ecf2a4 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:51.078967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e2d88-8bed-421a-92ca-411919ecf2a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:51.079236 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e2d88-8bed-421a-92ca-411919ecf2a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:51.087023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e2d88-8bed-421a-92ca-411919ecf2a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:51.088626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e2d88-8bed-421a-92ca-411919ecf2a4 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:51.097770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 722/1437] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:51.973151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ab9e-9edb-467f-83ed-e45c655d0589 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:51.973678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ab9e-9edb-467f-83ed-e45c655d0589 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:51.973805 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712ab9e-9edb-467f-83ed-e45c655d0589 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:51.975078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 11:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:51.979976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a33b2-f44c-4e21-bec1-1ba251945990 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:51.980405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a33b2-f44c-4e21-bec1-1ba251945990 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:51.980580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a33b2-f44c-4e21-bec1-1ba251945990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:51.999078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f40a33b2-f44c-4e21-bec1-1ba251945990 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:52.000298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f40a33b2-f44c-4e21-bec1-1ba251945990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:52.008215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 11:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:52.156234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712ab9e-9edb-467f-83ed-e45c655d0589 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:52.170738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712ab9e-9edb-467f-83ed-e45c655d0589 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:52.176034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded76af-0460-4846-bf8e-7569378886d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:52.176693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded76af-0460-4846-bf8e-7569378886d2 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:52.176981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded76af-0460-4846-bf8e-7569378886d2 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:52.177257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded76af-0460-4846-bf8e-7569378886d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:52.185183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded76af-0460-4846-bf8e-7569378886d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:52.186753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded76af-0460-4846-bf8e-7569378886d2 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:52.196085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 717/1440] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:54.313461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbe4df-6f2e-4989-9fb4-bd78d9ea36dd None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:54.313975 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbe4df-6f2e-4989-9fb4-bd78d9ea36dd None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:54.314069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbe4df-6f2e-4989-9fb4-bd78d9ea36dd None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:54.315832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 11:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:54.321391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0e1d-14f6-49c5-a1d8-22e9e772cc8f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:54.321820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0e1d-14f6-49c5-a1d8-22e9e772cc8f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:54.321953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0e1d-14f6-49c5-a1d8-22e9e772cc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:54.339402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-974d0e1d-14f6-49c5-a1d8-22e9e772cc8f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:54.341354 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-974d0e1d-14f6-49c5-a1d8-22e9e772cc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:54.349204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 11:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:54.386474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbe4df-6f2e-4989-9fb4-bd78d9ea36dd None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:54.396802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbe4df-6f2e-4989-9fb4-bd78d9ea36dd None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:54.400203 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbde50-9acb-4cd9-b307-1bfae53d6531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:54.400846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbde50-9acb-4cd9-b307-1bfae53d6531 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:54.401125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbde50-9acb-4cd9-b307-1bfae53d6531 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:54.401396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbde50-9acb-4cd9-b307-1bfae53d6531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:54.410365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbde50-9acb-4cd9-b307-1bfae53d6531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:54.411775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbde50-9acb-4cd9-b307-1bfae53d6531 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:54.421346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 725/1443] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:56.775045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305dce5-030f-441f-9abd-ffc0f6020897 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:56.775573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305dce5-030f-441f-9abd-ffc0f6020897 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:56.775573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305dce5-030f-441f-9abd-ffc0f6020897 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:56.777043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 11:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:56.782726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc09da-8225-4c7b-abd0-e89cd2bfcd8a None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:56.783235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc09da-8225-4c7b-abd0-e89cd2bfcd8a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:56.783335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc09da-8225-4c7b-abd0-e89cd2bfcd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:56.801627 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-07cc09da-8225-4c7b-abd0-e89cd2bfcd8a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:56.803045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-07cc09da-8225-4c7b-abd0-e89cd2bfcd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:56.810688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 11:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:56.849893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305dce5-030f-441f-9abd-ffc0f6020897 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:56.861213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305dce5-030f-441f-9abd-ffc0f6020897 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:56.864850 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fc472-1a28-4820-95c8-46906d8a5bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:56.865497 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc472-1a28-4820-95c8-46906d8a5bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:56.865785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc472-1a28-4820-95c8-46906d8a5bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:56.866067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc472-1a28-4820-95c8-46906d8a5bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:56.875058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fc472-1a28-4820-95c8-46906d8a5bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:56.876519 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fc472-1a28-4820-95c8-46906d8a5bf0 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:56.885769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 720/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 11:59:59.419849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9eabc-b7c2-4712-bc65-d634dc2b019b None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:59.420411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9eabc-b7c2-4712-bc65-d634dc2b019b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:59.420411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9eabc-b7c2-4712-bc65-d634dc2b019b None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:59.421787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 11:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 11:59:59.427064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b231f7-9caf-4fe9-8665-cafb64e547e4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:59.427468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b231f7-9caf-4fe9-8665-cafb64e547e4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:59.427629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b231f7-9caf-4fe9-8665-cafb64e547e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:59.445328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f5b231f7-9caf-4fe9-8665-cafb64e547e4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 11:59:59.446509 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f5b231f7-9caf-4fe9-8665-cafb64e547e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 11:59:59.455144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 11:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 11:59:59.497683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9eabc-b7c2-4712-bc65-d634dc2b019b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 11:59:59.508322 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9eabc-b7c2-4712-bc65-d634dc2b019b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 11:59:59.511759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a554a-2dc1-418c-81ec-c2607ed40b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 11:59:59.513196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a554a-2dc1-418c-81ec-c2607ed40b8b service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 11:59:59.513479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a554a-2dc1-418c-81ec-c2607ed40b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 11:59:59.513754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a554a-2dc1-418c-81ec-c2607ed40b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 11:59:59.522457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a554a-2dc1-418c-81ec-c2607ed40b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 11:59:59.523881 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a554a-2dc1-418c-81ec-c2607ed40b8b service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 11:59:59.533304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 728/1449] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 11:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:00:01.892800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4da2-7345-4a9e-a630-595ce2d3eb88 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:01.893386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4da2-7345-4a9e-a630-595ce2d3eb88 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:01.893386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a4da2-7345-4a9e-a630-595ce2d3eb88 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:01.894637 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 12:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:00:01.899899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e0165-b132-482a-9fe0-c430b1d75e56 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:01.900325 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e0165-b132-482a-9fe0-c430b1d75e56 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:01.900482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e0165-b132-482a-9fe0-c430b1d75e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:01.918015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-3d1e0165-b132-482a-9fe0-c430b1d75e56 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:01.919754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3d1e0165-b132-482a-9fe0-c430b1d75e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:01.927384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 12:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:01.965596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a4da2-7345-4a9e-a630-595ce2d3eb88 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:01.967318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4f8a4da2-7345-4a9e-a630-595ce2d3eb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:01.979899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a4da2-7345-4a9e-a630-595ce2d3eb88 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:01.984155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27685e69-fbd6-4b8b-8de5-fc2385b6bb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:01.984815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27685e69-fbd6-4b8b-8de5-fc2385b6bb4e service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:01.985100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27685e69-fbd6-4b8b-8de5-fc2385b6bb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:01.985378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27685e69-fbd6-4b8b-8de5-fc2385b6bb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:01.994040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27685e69-fbd6-4b8b-8de5-fc2385b6bb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:01.995460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27685e69-fbd6-4b8b-8de5-fc2385b6bb4e service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:02.004786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 723/1452] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:00:04.378285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a311-7062-4bcf-8a78-bfce3fd4e37f None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:04.378856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a311-7062-4bcf-8a78-bfce3fd4e37f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:04.378856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8a311-7062-4bcf-8a78-bfce3fd4e37f None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:04.380209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 12:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 12:00:04.385375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcfe42-d64e-4644-a444-6d66201dc8cc None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:04.385815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcfe42-d64e-4644-a444-6d66201dc8cc None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:04.385923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcfe42-d64e-4644-a444-6d66201dc8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:04.404240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-92bcfe42-d64e-4644-a444-6d66201dc8cc None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:04.405427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-92bcfe42-d64e-4644-a444-6d66201dc8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:04.413059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 12:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:04.451556 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8a311-7062-4bcf-8a78-bfce3fd4e37f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:04.461827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8a311-7062-4bcf-8a78-bfce3fd4e37f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:04.466022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108c1f4-f845-401d-8578-aa5bc92f0cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:04.466723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c1f4-f845-401d-8578-aa5bc92f0cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:04.467005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c1f4-f845-401d-8578-aa5bc92f0cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:04.467280 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c1f4-f845-401d-8578-aa5bc92f0cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:04.476196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108c1f4-f845-401d-8578-aa5bc92f0cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:04.477632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108c1f4-f845-401d-8578-aa5bc92f0cd8 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:04.486736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 731/1455] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:00:06.820302 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c73ce-3f69-4484-88c2-5c229d373f96 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:06.820841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c73ce-3f69-4484-88c2-5c229d373f96 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:06.820841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c73ce-3f69-4484-88c2-5c229d373f96 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:06.822123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 12:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:00:06.827999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519bfd6-d648-4579-a0f9-a03e1e5cd646 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:06.828477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519bfd6-d648-4579-a0f9-a03e1e5cd646 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:06.828594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519bfd6-d648-4579-a0f9-a03e1e5cd646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:06.846840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a519bfd6-d648-4579-a0f9-a03e1e5cd646 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:06.848013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a519bfd6-d648-4579-a0f9-a03e1e5cd646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:06.855673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:06.892667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c73ce-3f69-4484-88c2-5c229d373f96 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:06.903842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c73ce-3f69-4484-88c2-5c229d373f96 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:06.907457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4137-f4cc-4dcc-9e66-de30101efbec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:06.908092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4137-f4cc-4dcc-9e66-de30101efbec service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:06.908405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4137-f4cc-4dcc-9e66-de30101efbec service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:06.908683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4137-f4cc-4dcc-9e66-de30101efbec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:06.917366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a4137-f4cc-4dcc-9e66-de30101efbec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:06.919208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a4137-f4cc-4dcc-9e66-de30101efbec service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:06.928368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 726/1458] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:00:09.182652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac208b-c518-4d45-9631-b3c8a8f19358 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:09.183215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac208b-c518-4d45-9631-b3c8a8f19358 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:09.183215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac208b-c518-4d45-9631-b3c8a8f19358 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:09.184686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 12:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:00:09.190279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5daa6d-8a4c-4123-ad09-58503944ff3d None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:09.190720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5daa6d-8a4c-4123-ad09-58503944ff3d None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:09.190831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5daa6d-8a4c-4123-ad09-58503944ff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:09.208581 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ab5daa6d-8a4c-4123-ad09-58503944ff3d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:09.209755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ab5daa6d-8a4c-4123-ad09-58503944ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:09.218076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:00:09.254220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac208b-c518-4d45-9631-b3c8a8f19358 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:09.265459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac208b-c518-4d45-9631-b3c8a8f19358 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:09.268945 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331dba4-a390-450e-b642-f3b7ae578eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:09.269580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331dba4-a390-450e-b642-f3b7ae578eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:09.269860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331dba4-a390-450e-b642-f3b7ae578eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:09.270130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331dba4-a390-450e-b642-f3b7ae578eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:09.279256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331dba4-a390-450e-b642-f3b7ae578eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:09.280720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331dba4-a390-450e-b642-f3b7ae578eb7 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:09.290150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 734/1461] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:00:11.634391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1420e-0be6-470c-813d-bdcc3d6f8405 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:11.634968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1420e-0be6-470c-813d-bdcc3d6f8405 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:11.634968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1420e-0be6-470c-813d-bdcc3d6f8405 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:11.636360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 12:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:00:11.642729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e54592-268c-48a6-9c95-60eb51046c09 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:11.643183 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e54592-268c-48a6-9c95-60eb51046c09 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:11.643295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e54592-268c-48a6-9c95-60eb51046c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:11.660455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-67e54592-268c-48a6-9c95-60eb51046c09 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:11.661657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-67e54592-268c-48a6-9c95-60eb51046c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:11.669369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 12:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:11.707046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1420e-0be6-470c-813d-bdcc3d6f8405 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:11.718176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1420e-0be6-470c-813d-bdcc3d6f8405 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:11.721667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa898718-7142-473e-9687-61600bf2266d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:11.722292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa898718-7142-473e-9687-61600bf2266d service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:11.722573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa898718-7142-473e-9687-61600bf2266d service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:11.722848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa898718-7142-473e-9687-61600bf2266d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:11.731802 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa898718-7142-473e-9687-61600bf2266d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:11.733269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa898718-7142-473e-9687-61600bf2266d service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:11.742359 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 729/1464] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:00:14.017324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc212d5-e0ec-49dd-9015-db3c5619ba86 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:14.017870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc212d5-e0ec-49dd-9015-db3c5619ba86 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:14.017870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc212d5-e0ec-49dd-9015-db3c5619ba86 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:14.019281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 12:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:00:14.024894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d8bbe-beaa-4a8b-a6b1-21105f860372 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:14.025326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d8bbe-beaa-4a8b-a6b1-21105f860372 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:14.025455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d8bbe-beaa-4a8b-a6b1-21105f860372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:14.044282 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-322d8bbe-beaa-4a8b-a6b1-21105f860372 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:14.045454 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-322d8bbe-beaa-4a8b-a6b1-21105f860372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:14.053131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 12:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:14.089649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc212d5-e0ec-49dd-9015-db3c5619ba86 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:14.100756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc212d5-e0ec-49dd-9015-db3c5619ba86 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:14.104274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663abee-6a20-4d21-8de2-eb759e4c8a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:14.104905 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663abee-6a20-4d21-8de2-eb759e4c8a9e service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:14.105186 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663abee-6a20-4d21-8de2-eb759e4c8a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:14.106069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663abee-6a20-4d21-8de2-eb759e4c8a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:14.114742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663abee-6a20-4d21-8de2-eb759e4c8a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:14.116195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663abee-6a20-4d21-8de2-eb759e4c8a9e service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:14.125748 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 737/1467] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:00:16.356568 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3b5d-5159-4163-a543-c1959f6142f0 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:16.357154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3b5d-5159-4163-a543-c1959f6142f0 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:16.357154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3b5d-5159-4163-a543-c1959f6142f0 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:16.358483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 12:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:00:16.363823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297f4f-f0bb-4319-95b9-2c446d9e7c36 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:16.364280 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297f4f-f0bb-4319-95b9-2c446d9e7c36 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:16.364422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297f4f-f0bb-4319-95b9-2c446d9e7c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:16.381515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-5e297f4f-f0bb-4319-95b9-2c446d9e7c36 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:16.382678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5e297f4f-f0bb-4319-95b9-2c446d9e7c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:16.391278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:16.434862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c3b5d-5159-4163-a543-c1959f6142f0 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:16.445577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c3b5d-5159-4163-a543-c1959f6142f0 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:16.449050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88259902-76cc-4437-85e2-4f20937491b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:16.450178 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259902-76cc-4437-85e2-4f20937491b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:16.450458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259902-76cc-4437-85e2-4f20937491b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:16.450732 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259902-76cc-4437-85e2-4f20937491b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:16.459413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88259902-76cc-4437-85e2-4f20937491b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:16.460919 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88259902-76cc-4437-85e2-4f20937491b6 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:16.471109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 732/1470] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:00:49.526615 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4633fc-f875-4093-abcd-4091dd8b3850 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:49.527764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4633fc-f875-4093-abcd-4091dd8b3850 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:49.527945 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4633fc-f875-4093-abcd-4091dd8b3850 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:49.529241 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 739/1471] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 12:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:00:49.534376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f13d2-43c1-44c7-ad28-aaa6e19268cb None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:49.534825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f13d2-43c1-44c7-ad28-aaa6e19268cb None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:49.534931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f13d2-43c1-44c7-ad28-aaa6e19268cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:49.552411 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-bc0f13d2-43c1-44c7-ad28-aaa6e19268cb None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:49.553577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-bc0f13d2-43c1-44c7-ad28-aaa6e19268cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:49.561341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 733/1472] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:49.608083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0879c-ce60-440f-8010-5343bd38bcf7 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:49.608413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0879c-ce60-440f-8010-5343bd38bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:49.608697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0879c-ce60-440f-8010-5343bd38bcf7 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:49.610047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 740/1473] 10.222.0.58 () {54 vars in 962 bytes} [Tue May 17 12:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:00:49.614951 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3b13c-7773-43ee-be43-019d58b2066b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:49.615246 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3b13c-7773-43ee-be43-019d58b2066b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:49.615530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3b13c-7773-43ee-be43-019d58b2066b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:49.633953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-30e3b13c-7773-43ee-be43-019d58b2066b None None] MFA Rules not processed for user `767fe573dff349918c26995c206f2155`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:49.635131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-30e3b13c-7773-43ee-be43-019d58b2066b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:49.642075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 734/1474] 10.222.0.58 () {58 vars in 1059 bytes} [Tue May 17 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:49.649277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0879c-ce60-440f-8010-5343bd38bcf7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:49.660286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0879c-ce60-440f-8010-5343bd38bcf7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:49.663760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bb241-e2b7-4847-956b-06fd668f399d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767fe573dff349918c26995c206f2155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:49.664418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bb241-e2b7-4847-956b-06fd668f399d service glance] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:49.664703 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bb241-e2b7-4847-956b-06fd668f399d service glance] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:49.664976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bb241-e2b7-4847-956b-06fd668f399d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:49.673686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bb241-e2b7-4847-956b-06fd668f399d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:49.675111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bb241-e2b7-4847-956b-06fd668f399d service glance] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:49.684408 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 741/1475] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:00:51.989626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290e995-feb6-4fe9-9275-19ef137b96a7 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:51.990179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290e995-feb6-4fe9-9275-19ef137b96a7 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:51.990179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290e995-feb6-4fe9-9275-19ef137b96a7 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:51.991620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 735/1476] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 12:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:00:51.997445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a38848-46fd-4a49-a586-739858f67b76 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:51.997859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a38848-46fd-4a49-a586-739858f67b76 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:51.998001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a38848-46fd-4a49-a586-739858f67b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:52.016005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-63a38848-46fd-4a49-a586-739858f67b76 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:52.017230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-63a38848-46fd-4a49-a586-739858f67b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:52.025106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 742/1477] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:52.047482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290e995-feb6-4fe9-9275-19ef137b96a7 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:52.060125 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290e995-feb6-4fe9-9275-19ef137b96a7 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:52.064580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b19fa6-648a-421a-876b-db4442cc71e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:52.065467 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b19fa6-648a-421a-876b-db4442cc71e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:52.065749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b19fa6-648a-421a-876b-db4442cc71e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:52.066026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b19fa6-648a-421a-876b-db4442cc71e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:52.066757 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b19fa6-648a-421a-876b-db4442cc71e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:52.068537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: WARNING py.warnings [None req-a0b19fa6-648a-421a-876b-db4442cc71e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 12:00:52.068537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: warnings.warn(msg) May 17 12:00:52.068537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: May 17 12:00:52.069676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b19fa6-648a-421a-876b-db4442cc71e2 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:52.088756 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 736/1478] 10.222.0.58 () {56 vars in 1108 bytes} [Tue May 17 12:00:52 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:00:54.358103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe9b63-aecd-4f80-82bb-65e8fa5f1a3e None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:54.358645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe9b63-aecd-4f80-82bb-65e8fa5f1a3e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:54.358741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe9b63-aecd-4f80-82bb-65e8fa5f1a3e None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:54.360095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 743/1479] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 12:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:00:54.365352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfead118-94ef-4ae9-a286-46916a893a6c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:54.365799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfead118-94ef-4ae9-a286-46916a893a6c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:54.365898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfead118-94ef-4ae9-a286-46916a893a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:54.384226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-cfead118-94ef-4ae9-a286-46916a893a6c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:54.385421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-cfead118-94ef-4ae9-a286-46916a893a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:54.393689 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 737/1480] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 12:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:54.435686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe9b63-aecd-4f80-82bb-65e8fa5f1a3e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:54.450608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe9b63-aecd-4f80-82bb-65e8fa5f1a3e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:54.455886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8db43-0032-4496-98ff-8ef730a5e008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:54.456543 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8db43-0032-4496-98ff-8ef730a5e008 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:54.456827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8db43-0032-4496-98ff-8ef730a5e008 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:54.457102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8db43-0032-4496-98ff-8ef730a5e008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:54.464921 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8db43-0032-4496-98ff-8ef730a5e008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:54.466518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8db43-0032-4496-98ff-8ef730a5e008 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:54.475448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 744/1481] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:00:56.843495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a1721-e84b-4ea9-acba-26397db5d253 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:56.844036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a1721-e84b-4ea9-acba-26397db5d253 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:56.844036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a1721-e84b-4ea9-acba-26397db5d253 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:56.845387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 738/1482] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 12:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 12:00:56.850599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953a21-f35a-4703-9972-8a596e237fe9 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:56.851036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953a21-f35a-4703-9972-8a596e237fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:56.851141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953a21-f35a-4703-9972-8a596e237fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:56.869973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-e9953a21-f35a-4703-9972-8a596e237fe9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:56.871742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e9953a21-f35a-4703-9972-8a596e237fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:56.879445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 745/1483] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 12:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:56.914198 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a1721-e84b-4ea9-acba-26397db5d253 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:56.925336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a1721-e84b-4ea9-acba-26397db5d253 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:56.929163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050056a3-74e5-468a-b898-9298faa93fe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:56.929802 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050056a3-74e5-468a-b898-9298faa93fe4 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:56.930086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050056a3-74e5-468a-b898-9298faa93fe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:56.930361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050056a3-74e5-468a-b898-9298faa93fe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:56.939725 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050056a3-74e5-468a-b898-9298faa93fe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:56.941454 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050056a3-74e5-468a-b898-9298faa93fe4 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:56.950658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 739/1484] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:00:59.211265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e49e-991d-4aa9-b9d9-f05c9ada8eaf None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:59.211816 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e49e-991d-4aa9-b9d9-f05c9ada8eaf None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:59.211816 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5e49e-991d-4aa9-b9d9-f05c9ada8eaf None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:59.213257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 746/1485] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 12:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:00:59.218571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd2733-780f-4e9c-ae0e-3da9786fd69f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:59.218985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd2733-780f-4e9c-ae0e-3da9786fd69f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:59.219134 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd2733-780f-4e9c-ae0e-3da9786fd69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:59.238328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-b6dd2733-780f-4e9c-ae0e-3da9786fd69f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:00:59.239507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b6dd2733-780f-4e9c-ae0e-3da9786fd69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:00:59.247934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 740/1486] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 12:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:00:59.284917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5e49e-991d-4aa9-b9d9-f05c9ada8eaf None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:00:59.295780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5e49e-991d-4aa9-b9d9-f05c9ada8eaf None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:00:59.299250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848015-8b10-482b-93d5-18319c7dcd5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:00:59.299878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848015-8b10-482b-93d5-18319c7dcd5d service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:00:59.300160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848015-8b10-482b-93d5-18319c7dcd5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:00:59.300471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848015-8b10-482b-93d5-18319c7dcd5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:00:59.310019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8848015-8b10-482b-93d5-18319c7dcd5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:00:59.311480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8848015-8b10-482b-93d5-18319c7dcd5d service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:00:59.320834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 747/1487] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:01:01.708630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bc87-87cf-493c-8334-5a16191e3602 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:01:01.709207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bc87-87cf-493c-8334-5a16191e3602 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:01:01.709207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bc87-87cf-493c-8334-5a16191e3602 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:01:01.710533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 741/1488] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 12:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:01:01.716635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f705d0-f894-4892-84c3-732f87167d5c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:01:01.717095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f705d0-f894-4892-84c3-732f87167d5c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:01:01.717188 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f705d0-f894-4892-84c3-732f87167d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:01:01.735210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a5f705d0-f894-4892-84c3-732f87167d5c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:01:01.736563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a5f705d0-f894-4892-84c3-732f87167d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:01:01.744437 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 748/1489] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 12:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:01:01.784833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858bc87-87cf-493c-8334-5a16191e3602 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:01:01.795823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858bc87-87cf-493c-8334-5a16191e3602 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:01:01.799383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508610e-2466-4d5b-bdca-dde6ed0cf61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:01:01.800014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508610e-2466-4d5b-bdca-dde6ed0cf61e service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:01:01.800334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508610e-2466-4d5b-bdca-dde6ed0cf61e service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:01:01.800610 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508610e-2466-4d5b-bdca-dde6ed0cf61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:01:01.810416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508610e-2466-4d5b-bdca-dde6ed0cf61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:01:01.811984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508610e-2466-4d5b-bdca-dde6ed0cf61e service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:01:01.821963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 742/1490] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:01:04.266618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dffe8-6c5e-4413-ab90-aad6311b0016 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:01:04.267180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dffe8-6c5e-4413-ab90-aad6311b0016 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:01:04.267180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dffe8-6c5e-4413-ab90-aad6311b0016 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:01:04.268655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 749/1491] 10.222.0.58 () {54 vars in 926 bytes} [Tue May 17 12:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:01:04.273807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fd71-6e89-46a3-857c-c4d62fc9ffcb None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:01:04.274261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fd71-6e89-46a3-857c-c4d62fc9ffcb None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:01:04.274375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fd71-6e89-46a3-857c-c4d62fc9ffcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:01:04.291577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ecd1fd71-6e89-46a3-857c-c4d62fc9ffcb None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:01:04.292780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ecd1fd71-6e89-46a3-857c-c4d62fc9ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:01:04.300390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 743/1492] 10.222.0.58 () {58 vars in 1023 bytes} [Tue May 17 12:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:01:04.338691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dffe8-6c5e-4413-ab90-aad6311b0016 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:01:04.349592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dffe8-6c5e-4413-ab90-aad6311b0016 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:01:04.353027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9e505-4bc1-4f2c-9200-36f041a354b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:01:04.353653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9e505-4bc1-4f2c-9200-36f041a354b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:01:04.353934 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9e505-4bc1-4f2c-9200-36f041a354b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:01:04.354202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9e505-4bc1-4f2c-9200-36f041a354b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:01:04.363181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9e505-4bc1-4f2c-9200-36f041a354b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:01:04.364663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9e505-4bc1-4f2c-9200-36f041a354b4 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:01:04.374123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 750/1493] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:02:32.058767 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb43c1-a3c4-47cd-8073-c2fb1fb8700d None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.059388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb43c1-a3c4-47cd-8073-c2fb1fb8700d None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.059388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb43c1-a3c4-47cd-8073-c2fb1fb8700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.077365 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a3eb43c1-a3c4-47cd-8073-c2fb1fb8700d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:02:32.078529 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a3eb43c1-a3c4-47cd-8073-c2fb1fb8700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:02:32.086132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 744/1494] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:02:32.095698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccc37c-51c7-48be-bc86-c6fb4d5b6eaf None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.096170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccc37c-51c7-48be-bc86-c6fb4d5b6eaf None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.096295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccc37c-51c7-48be-bc86-c6fb4d5b6eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.114016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c8ccc37c-51c7-48be-bc86-c6fb4d5b6eaf None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:02:32.115213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c8ccc37c-51c7-48be-bc86-c6fb4d5b6eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:02:32.122998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 751/1495] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:02:32.127501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb43c1-a3c4-47cd-8073-c2fb1fb8700d None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:02:32.137568 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb43c1-a3c4-47cd-8073-c2fb1fb8700d None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:02:32.141953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcfcca-861a-4143-8495-c9e929115502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:02:32.142595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcfcca-861a-4143-8495-c9e929115502 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.142874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcfcca-861a-4143-8495-c9e929115502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.143145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcfcca-861a-4143-8495-c9e929115502 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.143862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcfcca-861a-4143-8495-c9e929115502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:02:32.144166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcfcca-861a-4143-8495-c9e929115502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:02:32.145192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: WARNING py.warnings [None req-8bbcfcca-861a-4143-8495-c9e929115502 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 12:02:32.145192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: warnings.warn(msg) May 17 12:02:32.145192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: May 17 12:02:32.146054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcfcca-861a-4143-8495-c9e929115502 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:02:32.157825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 745/1496] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:02:32.166142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccc37c-51c7-48be-bc86-c6fb4d5b6eaf None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:02:32.175105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccc37c-51c7-48be-bc86-c6fb4d5b6eaf None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:02:32.179608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4b86b-092a-40be-a5f0-e1f2e383dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:02:32.180296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4b86b-092a-40be-a5f0-e1f2e383dc7a admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.180581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4b86b-092a-40be-a5f0-e1f2e383dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.180855 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4b86b-092a-40be-a5f0-e1f2e383dc7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.181888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4b86b-092a-40be-a5f0-e1f2e383dc7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:02:32.183645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: WARNING py.warnings [None req-acc4b86b-092a-40be-a5f0-e1f2e383dc7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 12:02:32.183645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: warnings.warn(msg) May 17 12:02:32.183645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: May 17 12:02:32.184877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4b86b-092a-40be-a5f0-e1f2e383dc7a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:02:32.219990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 752/1497] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:02:32 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:02:32.224308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcfcca-861a-4143-8495-c9e929115502 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:02:32.234040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcfcca-861a-4143-8495-c9e929115502 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:02:32.287656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fc171-7554-4b13-ab93-365f3f50464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:02:32.288341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fc171-7554-4b13-ab93-365f3f50464d admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.288625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fc171-7554-4b13-ab93-365f3f50464d admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.288902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fc171-7554-4b13-ab93-365f3f50464d admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.289593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fc171-7554-4b13-ab93-365f3f50464d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:02:32.290741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: WARNING py.warnings [None req-559fc171-7554-4b13-ab93-365f3f50464d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 12:02:32.290741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: warnings.warn(msg) May 17 12:02:32.290741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: May 17 12:02:32.292011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fc171-7554-4b13-ab93-365f3f50464d admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:02:32.316334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 746/1498] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:02:32 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:02:32.320460 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4b86b-092a-40be-a5f0-e1f2e383dc7a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:02:32.331078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4b86b-092a-40be-a5f0-e1f2e383dc7a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:02:32.335643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e9fc7-fd41-47c9-8f94-6f33a804133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:02:32.336332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9fc7-fd41-47c9-8f94-6f33a804133e admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.336623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9fc7-fd41-47c9-8f94-6f33a804133e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.336900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9fc7-fd41-47c9-8f94-6f33a804133e admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.338367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e9fc7-fd41-47c9-8f94-6f33a804133e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:02:32.339392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: WARNING py.warnings [None req-9e8e9fc7-fd41-47c9-8f94-6f33a804133e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 12:02:32.339392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: warnings.warn(msg) May 17 12:02:32.339392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: May 17 12:02:32.340294 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e9fc7-fd41-47c9-8f94-6f33a804133e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:02:32.352726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 753/1499] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:02:32.356733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fc171-7554-4b13-ab93-365f3f50464d admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:02:32.366328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fc171-7554-4b13-ab93-365f3f50464d admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:02:32.370890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0dbba-299c-4214-b233-70ea29709e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:02:32.371525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0dbba-299c-4214-b233-70ea29709e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.371804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0dbba-299c-4214-b233-70ea29709e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.372075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0dbba-299c-4214-b233-70ea29709e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.372844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0dbba-299c-4214-b233-70ea29709e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:02:32.373847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: WARNING py.warnings [None req-6ab0dbba-299c-4214-b233-70ea29709e2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 12:02:32.373847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: warnings.warn(msg) May 17 12:02:32.373847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: May 17 12:02:32.374718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0dbba-299c-4214-b233-70ea29709e2c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:02:32.388317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 747/1500] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:02:32.392347 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e9fc7-fd41-47c9-8f94-6f33a804133e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:02:32.402629 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e9fc7-fd41-47c9-8f94-6f33a804133e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:02:32.407054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049fa7e-5b61-460b-aec5-7752e9bc940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:02:32.407904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049fa7e-5b61-460b-aec5-7752e9bc940a admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.408198 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049fa7e-5b61-460b-aec5-7752e9bc940a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.408486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049fa7e-5b61-460b-aec5-7752e9bc940a admin admin] PATH_INFO: `/v3/projects/0ddec041410a45e093f360422a01b94c/users/dbe65dfcefc04a169d7687167e30c59e/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.422918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049fa7e-5b61-460b-aec5-7752e9bc940a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddec041410a45e093f360422a01b94c, user_id=dbe65dfcefc04a169d7687167e30c59e, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:02:32.423950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: WARNING py.warnings [None req-3049fa7e-5b61-460b-aec5-7752e9bc940a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 12:02:32.423950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: warnings.warn(msg) May 17 12:02:32.423950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: May 17 12:02:32.425890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049fa7e-5b61-460b-aec5-7752e9bc940a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:02:32.438502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 754/1501] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:02:32 2022] PUT /identity/v3/projects/0ddec041410a45e093f360422a01b94c/users/dbe65dfcefc04a169d7687167e30c59e/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:02:32.450655 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9ec9-746f-4302-b435-b4e0607093d7 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.450947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9ec9-746f-4302-b435-b4e0607093d7 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.451241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9ec9-746f-4302-b435-b4e0607093d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.477499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-b7bd9ec9-746f-4302-b435-b4e0607093d7 None None] MFA Rules not processed for user `dbe65dfcefc04a169d7687167e30c59e`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:02:32.478733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b7bd9ec9-746f-4302-b435-b4e0607093d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:02:32.543057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 748/1502] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:02:32.556283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50539267-9051-4b54-9f9b-3729fc528a90 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.556576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50539267-9051-4b54-9f9b-3729fc528a90 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.556853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50539267-9051-4b54-9f9b-3729fc528a90 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.558214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 755/1503] 10.222.0.58 () {54 vars in 963 bytes} [Tue May 17 12:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:02:32.563033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293194e6-83ae-476c-91c0-8fedae386805 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.563326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293194e6-83ae-476c-91c0-8fedae386805 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.563607 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293194e6-83ae-476c-91c0-8fedae386805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.581163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-293194e6-83ae-476c-91c0-8fedae386805 None None] MFA Rules not processed for user `1b14c0c2f0cd4459915dbbe3b5939159`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:02:32.582279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-293194e6-83ae-476c-91c0-8fedae386805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:02:32.630512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 749/1504] 10.222.0.58 () {58 vars in 1060 bytes} [Tue May 17 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:02:32.638047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50539267-9051-4b54-9f9b-3729fc528a90 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:02:32.648144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50539267-9051-4b54-9f9b-3729fc528a90 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:02:32.652024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b4720-589d-4941-a41f-4262ea47c019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:02:32.652676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b4720-589d-4941-a41f-4262ea47c019 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.652957 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b4720-589d-4941-a41f-4262ea47c019 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.653229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b4720-589d-4941-a41f-4262ea47c019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.662585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b4720-589d-4941-a41f-4262ea47c019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:02:32.664938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b4720-589d-4941-a41f-4262ea47c019 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:02:32.674436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 756/1505] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:02:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:02:32.716556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65074f45-517f-49ad-b1a9-573c5056f22f None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.716855 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65074f45-517f-49ad-b1a9-573c5056f22f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.717136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65074f45-517f-49ad-b1a9-573c5056f22f None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.718447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 750/1506] 10.222.0.58 () {52 vars in 829 bytes} [Tue May 17 12:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:02:32.721910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b4720-589d-4941-a41f-4262ea47c019 service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:02:32.781207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b4720-589d-4941-a41f-4262ea47c019 service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:02:32.785646 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:02:32.786501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.786783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.787057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] PATH_INFO: `/v3/users/dbe65dfcefc04a169d7687167e30c59e` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.788263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbe65dfcefc04a169d7687167e30c59e)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:02:32.789294 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: WARNING py.warnings [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 12:02:32.789294 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: warnings.warn(msg) May 17 12:02:32.789294 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: May 17 12:02:32.791590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:02:32.855791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbe65dfcefc04a169d7687167e30c59e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:02:32.856524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbe65dfcefc04a169d7687167e30c59e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:02:32.868477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbe65dfcefc04a169d7687167e30c59e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:02:32.877110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbe65dfcefc04a169d7687167e30c59e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:02:32.877832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbe65dfcefc04a169d7687167e30c59e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:02:32.901965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 757/1507] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:02:32 2022] DELETE /identity/v3/users/dbe65dfcefc04a169d7687167e30c59e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:02:32.906364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320be19d-ab6a-49e0-afd4-05d0a406d825 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:32.906658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320be19d-ab6a-49e0-afd4-05d0a406d825 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:32.906936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320be19d-ab6a-49e0-afd4-05d0a406d825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:32.925175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-320be19d-ab6a-49e0-afd4-05d0a406d825 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:02:32.926370 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-320be19d-ab6a-49e0-afd4-05d0a406d825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:02:32.982660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 751/1508] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:02:32.992356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:02:32.993883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:02:33.049003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00806d8c-cc3b-42e2-8185-fb232d208940 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:02:33.052655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6d6bf-7ae6-44f7-a6aa-f33f1bba802d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:02:33.053305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d6bf-7ae6-44f7-a6aa-f33f1bba802d service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:33.053588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d6bf-7ae6-44f7-a6aa-f33f1bba802d service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:33.053865 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d6bf-7ae6-44f7-a6aa-f33f1bba802d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:33.062586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6d6bf-7ae6-44f7-a6aa-f33f1bba802d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:02:33.064022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6d6bf-7ae6-44f7-a6aa-f33f1bba802d service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:02:33.073876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 758/1509] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:02:33.416507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320be19d-ab6a-49e0-afd4-05d0a406d825 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:02:33.418190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-320be19d-ab6a-49e0-afd4-05d0a406d825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:02:33.430043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320be19d-ab6a-49e0-afd4-05d0a406d825 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:02:33.436611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:02:33.437837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:02:33.438138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:02:33.438408 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] PATH_INFO: `/v3/projects/0ddec041410a45e093f360422a01b94c` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:02:33.439591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddec041410a45e093f360422a01b94c)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:02:33.441718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: WARNING py.warnings [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 12:02:33.441718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: warnings.warn(msg) May 17 12:02:33.441718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: May 17 12:02:33.443276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:02:33.502124 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddec041410a45e093f360422a01b94c', 'request_id': 'req-d3a09510-69b1-4638-8f13-7568ec788902'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:02:33.512645 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddec041410a45e093f360422a01b94c', 'request_id': 'req-d3a09510-69b1-4638-8f13-7568ec788902'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:02:33.526671 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddec041410a45e093f360422a01b94c', 'request_id': 'req-d3a09510-69b1-4638-8f13-7568ec788902'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:02:33.537536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] The token cache is being invalidate because project 0ddec041410a45e093f360422a01b94c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:02:33.537825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:02:33.538489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d3a09510-69b1-4638-8f13-7568ec788902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:02:33.540143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 752/1510] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:02:33 2022] DELETE /identity/v3/projects/0ddec041410a45e093f360422a01b94c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:04:15.473538 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ad20-387b-483f-9254-06860cb9949a None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:15.474102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ad20-387b-483f-9254-06860cb9949a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:15.474102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ad20-387b-483f-9254-06860cb9949a None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:15.475394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 12:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:04:15.480678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a258b6-91c1-43dd-a7e2-7f19e72e57b1 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:15.481131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a258b6-91c1-43dd-a7e2-7f19e72e57b1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:15.481239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a258b6-91c1-43dd-a7e2-7f19e72e57b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:15.499620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-57a258b6-91c1-43dd-a7e2-7f19e72e57b1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:04:15.500848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-57a258b6-91c1-43dd-a7e2-7f19e72e57b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:15.560352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 12:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:04:15.728480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2ad20-387b-483f-9254-06860cb9949a None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:04:15.730678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-90f2ad20-387b-483f-9254-06860cb9949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:15.804560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2ad20-387b-483f-9254-06860cb9949a None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:04:15.810618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a8c1c-7d98-4935-b4fa-a1f000b864b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:04:15.811261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a8c1c-7d98-4935-b4fa-a1f000b864b1 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:15.811550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a8c1c-7d98-4935-b4fa-a1f000b864b1 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:15.811826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a8c1c-7d98-4935-b4fa-a1f000b864b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:15.820143 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a8c1c-7d98-4935-b4fa-a1f000b864b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:04:15.821775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a8c1c-7d98-4935-b4fa-a1f000b864b1 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:04:15.831027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 760/1513] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:04:16.735025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b57ce-27f5-4888-ad17-4d789e431b05 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:16.735597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b57ce-27f5-4888-ad17-4d789e431b05 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:16.735597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b57ce-27f5-4888-ad17-4d789e431b05 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:16.736991 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 12:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:04:16.741847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e637e-7965-4fdf-aed2-f997755b0d5e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:16.742245 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e637e-7965-4fdf-aed2-f997755b0d5e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:16.742424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e637e-7965-4fdf-aed2-f997755b0d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:16.760677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ca8e637e-7965-4fdf-aed2-f997755b0d5e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:04:16.761865 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ca8e637e-7965-4fdf-aed2-f997755b0d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:16.769434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:04:16.924974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b57ce-27f5-4888-ad17-4d789e431b05 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:04:16.939670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b57ce-27f5-4888-ad17-4d789e431b05 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:04:16.945305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af188a6-6608-4a37-a10c-4f739da579e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:04:16.945934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af188a6-6608-4a37-a10c-4f739da579e7 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:16.946214 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af188a6-6608-4a37-a10c-4f739da579e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:16.946486 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af188a6-6608-4a37-a10c-4f739da579e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:16.954695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af188a6-6608-4a37-a10c-4f739da579e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:04:16.956312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af188a6-6608-4a37-a10c-4f739da579e7 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:04:16.965518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 755/1516] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:04:17.123563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f748f3e-f7d8-4320-ba23-497c9c27b43f None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:17.123848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f748f3e-f7d8-4320-ba23-497c9c27b43f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:17.124120 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f748f3e-f7d8-4320-ba23-497c9c27b43f None None] PATH_INFO: `/v3` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:17.125527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 762/1517] 10.222.0.35 () {54 vars in 925 bytes} [Tue May 17 12:04:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:04:17.147472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ac1e-ca7b-404b-9708-42cbddaaaa60 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:17.147760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ac1e-ca7b-404b-9708-42cbddaaaa60 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:17.148036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ac1e-ca7b-404b-9708-42cbddaaaa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:17.166254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-06a9ac1e-ca7b-404b-9708-42cbddaaaa60 None None] MFA Rules not processed for user `c5222a62941948229324ec8c073caf86`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:04:17.168052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-06a9ac1e-ca7b-404b-9708-42cbddaaaa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:17.227078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 756/1518] 10.222.0.35 () {58 vars in 1015 bytes} [Tue May 17 12:04:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:04:26.252907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64baaa-5503-4ab7-913c-1316b4acd300 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:26.253448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64baaa-5503-4ab7-913c-1316b4acd300 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:26.253448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64baaa-5503-4ab7-913c-1316b4acd300 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:26.254814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 763/1519] 10.222.0.58 () {54 vars in 960 bytes} [Tue May 17 12:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:04:26.260252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc07d-6824-4c17-a728-8c6110454556 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:26.260702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc07d-6824-4c17-a728-8c6110454556 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:26.260998 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc07d-6824-4c17-a728-8c6110454556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:26.279519 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-978dc07d-6824-4c17-a728-8c6110454556 None None] MFA Rules not processed for user `c5222a62941948229324ec8c073caf86`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:04:26.280781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-978dc07d-6824-4c17-a728-8c6110454556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:26.289177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 757/1520] 10.222.0.58 () {58 vars in 1057 bytes} [Tue May 17 12:04:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:04:26.297401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64baaa-5503-4ab7-913c-1316b4acd300 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:04:26.311575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64baaa-5503-4ab7-913c-1316b4acd300 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:04:26.316497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf93d6c-edbd-49c1-b10f-15567e098f3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5222a62941948229324ec8c073caf86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:04:26.317129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf93d6c-edbd-49c1-b10f-15567e098f3e service placement] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:26.317670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf93d6c-edbd-49c1-b10f-15567e098f3e service placement] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:26.317946 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf93d6c-edbd-49c1-b10f-15567e098f3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:26.327115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf93d6c-edbd-49c1-b10f-15567e098f3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:04:26.328729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf93d6c-edbd-49c1-b10f-15567e098f3e service placement] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:04:26.338662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 764/1521] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:04:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:04:28.294880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e450d-7a0b-4482-b8c0-0174679d5335 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:28.295449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e450d-7a0b-4482-b8c0-0174679d5335 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:28.295449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e450d-7a0b-4482-b8c0-0174679d5335 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:28.296826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 12:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:04:28.301685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b72b2-55ba-4374-ba53-cf4df69e5bb1 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:28.302145 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b72b2-55ba-4374-ba53-cf4df69e5bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:28.302278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b72b2-55ba-4374-ba53-cf4df69e5bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:28.320404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-331b72b2-55ba-4374-ba53-cf4df69e5bb1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:04:28.321583 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-331b72b2-55ba-4374-ba53-cf4df69e5bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:28.329355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:04:28.480089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e450d-7a0b-4482-b8c0-0174679d5335 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:04:28.494462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e450d-7a0b-4482-b8c0-0174679d5335 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:04:28.499928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f0bf4-8a2f-4706-b3f7-64041dab3030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:04:28.500603 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f0bf4-8a2f-4706-b3f7-64041dab3030 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:28.500888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f0bf4-8a2f-4706-b3f7-64041dab3030 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:28.501186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f0bf4-8a2f-4706-b3f7-64041dab3030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:28.509172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f0bf4-8a2f-4706-b3f7-64041dab3030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:04:28.510983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f0bf4-8a2f-4706-b3f7-64041dab3030 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:04:28.520821 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 759/1524] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:04:29.399013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0550ddf-54c0-4c80-bb45-7273b4fb2dd8 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:29.399570 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0550ddf-54c0-4c80-bb45-7273b4fb2dd8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:29.399570 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0550ddf-54c0-4c80-bb45-7273b4fb2dd8 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:29.400982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 12:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:04:29.405813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc7152-0773-4f5f-8bd6-0dd491e22f57 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:29.406257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc7152-0773-4f5f-8bd6-0dd491e22f57 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:29.406373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc7152-0773-4f5f-8bd6-0dd491e22f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:29.424599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-40bc7152-0773-4f5f-8bd6-0dd491e22f57 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:04:29.425789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-40bc7152-0773-4f5f-8bd6-0dd491e22f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:29.434140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 12:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:04:29.626064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0550ddf-54c0-4c80-bb45-7273b4fb2dd8 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:04:29.641140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0550ddf-54c0-4c80-bb45-7273b4fb2dd8 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:04:29.646810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c04c4-c245-44fe-846e-57fcfa112ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:04:29.647457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c04c4-c245-44fe-846e-57fcfa112ecf service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:29.647745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c04c4-c245-44fe-846e-57fcfa112ecf service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:29.648026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c04c4-c245-44fe-846e-57fcfa112ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:29.656857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c04c4-c245-44fe-846e-57fcfa112ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:04:29.658449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c04c4-c245-44fe-846e-57fcfa112ecf service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:04:29.668767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 767/1527] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:04:33.819005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd81c5-7cdc-4725-b9fe-4c93c9a58a00 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:33.819512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd81c5-7cdc-4725-b9fe-4c93c9a58a00 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:33.819512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd81c5-7cdc-4725-b9fe-4c93c9a58a00 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:33.820873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 12:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:04:33.826047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79792c-8b90-438e-bef7-72bdfa87026c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:33.826448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79792c-8b90-438e-bef7-72bdfa87026c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:33.826628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79792c-8b90-438e-bef7-72bdfa87026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:33.844860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-4d79792c-8b90-438e-bef7-72bdfa87026c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:04:33.846044 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4d79792c-8b90-438e-bef7-72bdfa87026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:33.854403 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 12:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:04:33.889740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd81c5-7cdc-4725-b9fe-4c93c9a58a00 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:04:33.891388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-febd81c5-7cdc-4725-b9fe-4c93c9a58a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:33.947855 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd81c5-7cdc-4725-b9fe-4c93c9a58a00 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:04:33.951518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc24f5-e831-4a09-9001-36b102fc5864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:04:33.952152 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc24f5-e831-4a09-9001-36b102fc5864 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:33.952468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc24f5-e831-4a09-9001-36b102fc5864 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:33.952769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc24f5-e831-4a09-9001-36b102fc5864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:33.962049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc24f5-e831-4a09-9001-36b102fc5864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:04:33.964080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc24f5-e831-4a09-9001-36b102fc5864 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:04:33.973293 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 762/1530] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:04:36.193733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c6f08-d961-459d-9564-5006a0a67bbb None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:36.194303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c6f08-d961-459d-9564-5006a0a67bbb None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:36.194303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c6f08-d961-459d-9564-5006a0a67bbb None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:36.195670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 12:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:04:36.201383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168ec4-4d4d-4729-a352-64844067ac03 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:36.201810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168ec4-4d4d-4729-a352-64844067ac03 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:36.201956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168ec4-4d4d-4729-a352-64844067ac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:36.222006 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-43168ec4-4d4d-4729-a352-64844067ac03 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:04:36.223202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-43168ec4-4d4d-4729-a352-64844067ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:36.232604 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 12:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:04:36.269220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c6f08-d961-459d-9564-5006a0a67bbb None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:04:36.270902 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-804c6f08-d961-459d-9564-5006a0a67bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:36.284084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c6f08-d961-459d-9564-5006a0a67bbb None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:04:36.287511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f671f-2b3b-47e9-b582-2e1da47213a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:04:36.288145 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f671f-2b3b-47e9-b582-2e1da47213a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:36.288459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f671f-2b3b-47e9-b582-2e1da47213a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:36.288736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f671f-2b3b-47e9-b582-2e1da47213a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:36.297991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f671f-2b3b-47e9-b582-2e1da47213a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:04:36.299430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f671f-2b3b-47e9-b582-2e1da47213a4 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:04:36.309238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 770/1533] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:04:39.958310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bfd25-656e-496e-8462-633b154204c0 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:39.958869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bfd25-656e-496e-8462-633b154204c0 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:39.958869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bfd25-656e-496e-8462-633b154204c0 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:39.960298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 12:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:04:39.966195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9780c2b-89d0-4cff-bf4b-84254360a036 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:39.966619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9780c2b-89d0-4cff-bf4b-84254360a036 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:39.966752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9780c2b-89d0-4cff-bf4b-84254360a036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:39.984072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a9780c2b-89d0-4cff-bf4b-84254360a036 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:04:39.985267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a9780c2b-89d0-4cff-bf4b-84254360a036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:39.992837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 12:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:04:40.267739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bfd25-656e-496e-8462-633b154204c0 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:04:40.269407 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c22bfd25-656e-496e-8462-633b154204c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:40.324778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bfd25-656e-496e-8462-633b154204c0 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:04:40.328263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f826559-810b-43b2-b9b2-105e51efd1a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:04:40.328895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f826559-810b-43b2-b9b2-105e51efd1a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:40.329171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f826559-810b-43b2-b9b2-105e51efd1a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:40.329439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f826559-810b-43b2-b9b2-105e51efd1a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:40.338172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f826559-810b-43b2-b9b2-105e51efd1a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:04:40.340297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f826559-810b-43b2-b9b2-105e51efd1a5 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:04:40.349659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 765/1536] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:04:42.626265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063577f4-e04d-4d1b-8020-2be188ff3197 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:42.626826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063577f4-e04d-4d1b-8020-2be188ff3197 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:42.626826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063577f4-e04d-4d1b-8020-2be188ff3197 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:42.628277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 12:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:04:42.633530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b390-88ff-459a-89f1-5e042a17f296 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:42.633946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b390-88ff-459a-89f1-5e042a17f296 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:42.634087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b390-88ff-459a-89f1-5e042a17f296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:42.652155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-6bf9b390-88ff-459a-89f1-5e042a17f296 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:04:42.653360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6bf9b390-88ff-459a-89f1-5e042a17f296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:42.661464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 12:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:04:42.945410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063577f4-e04d-4d1b-8020-2be188ff3197 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:04:42.947087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-063577f4-e04d-4d1b-8020-2be188ff3197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:04:42.959708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063577f4-e04d-4d1b-8020-2be188ff3197 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:04:42.963283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656650e-b6bc-45c4-a298-85337a55f4c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:04:42.963913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656650e-b6bc-45c4-a298-85337a55f4c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:04:42.964213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656650e-b6bc-45c4-a298-85337a55f4c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:04:42.964494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656650e-b6bc-45c4-a298-85337a55f4c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:04:42.973212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656650e-b6bc-45c4-a298-85337a55f4c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:04:42.974684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656650e-b6bc-45c4-a298-85337a55f4c7 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:04:42.984741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 773/1539] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:13.772712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8abb3-9515-405e-af59-6c04453ff9ff None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:13.773348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8abb3-9515-405e-af59-6c04453ff9ff None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:13.773348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8abb3-9515-405e-af59-6c04453ff9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:13.804722 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5ca2f-5cf9-4452-8833-9885feaf83f3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:13.805871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5ca2f-5cf9-4452-8833-9885feaf83f3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:13.806417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5ca2f-5cf9-4452-8833-9885feaf83f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:13.809202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ebd8abb3-9515-405e-af59-6c04453ff9ff None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:13.810578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ebd8abb3-9515-405e-af59-6c04453ff9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:13.826199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 767/1540] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:06:13.827524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90853f-6f75-41cd-af71-8517d4e90bee None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:13.827809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90853f-6f75-41cd-af71-8517d4e90bee None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:13.828081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90853f-6f75-41cd-af71-8517d4e90bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:13.840354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-08f5ca2f-5cf9-4452-8833-9885feaf83f3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:13.841941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-08f5ca2f-5cf9-4452-8833-9885feaf83f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:13.857455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-bc90853f-6f75-41cd-af71-8517d4e90bee None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:13.857938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 774/1541] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:13.858552 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-bc90853f-6f75-41cd-af71-8517d4e90bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:13.859837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5c0ce-7a31-4ca0-98c7-cdae97b90105 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:13.860367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5c0ce-7a31-4ca0-98c7-cdae97b90105 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:13.860871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5c0ce-7a31-4ca0-98c7-cdae97b90105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:13.873836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 768/1542] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:06:13.873836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701aa5-adc6-47d6-a407-daca3fd5cc91 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:13.873836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701aa5-adc6-47d6-a407-daca3fd5cc91 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:13.873836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701aa5-adc6-47d6-a407-daca3fd5cc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:13.887640 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-17c5c0ce-7a31-4ca0-98c7-cdae97b90105 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:13.889223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-17c5c0ce-7a31-4ca0-98c7-cdae97b90105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:13.909054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 775/1543] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:13.909275 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-45701aa5-adc6-47d6-a407-daca3fd5cc91 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:13.910749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-45701aa5-adc6-47d6-a407-daca3fd5cc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:13.911158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9215a-3c70-42b8-9435-c60a9eca13c2 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:13.911669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9215a-3c70-42b8-9435-c60a9eca13c2 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:13.912160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9215a-3c70-42b8-9435-c60a9eca13c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:13.927598 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 769/1544] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:13.931577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f1ae2-d2bd-4476-975d-97bbbeaa7050 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:13.931577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f1ae2-d2bd-4476-975d-97bbbeaa7050 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:13.931577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f1ae2-d2bd-4476-975d-97bbbeaa7050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:13.940593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-88a9215a-3c70-42b8-9435-c60a9eca13c2 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:13.942140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-88a9215a-3c70-42b8-9435-c60a9eca13c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:13.958763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 776/1545] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:13.961305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30a6da-2f6c-4e73-8a93-7a3dd65e361a None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:13.961828 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30a6da-2f6c-4e73-8a93-7a3dd65e361a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:13.968147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30a6da-2f6c-4e73-8a93-7a3dd65e361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:13.972433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-850f1ae2-d2bd-4476-975d-97bbbeaa7050 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:13.973748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-850f1ae2-d2bd-4476-975d-97bbbeaa7050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:13.987428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 770/1546] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:13.989071 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f1ae2-d2bd-4476-975d-97bbbeaa7050 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:13.989711 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1c30a6da-2f6c-4e73-8a93-7a3dd65e361a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:13.991267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1c30a6da-2f6c-4e73-8a93-7a3dd65e361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:14.000287 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 777/1547] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:14.000988 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f1ae2-d2bd-4476-975d-97bbbeaa7050 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.001611 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30a6da-2f6c-4e73-8a93-7a3dd65e361a None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.007086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd188f-1593-47a4-b2ab-93c79211b028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.007751 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd188f-1593-47a4-b2ab-93c79211b028 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.008036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd188f-1593-47a4-b2ab-93c79211b028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.008348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd188f-1593-47a4-b2ab-93c79211b028 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.009842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd188f-1593-47a4-b2ab-93c79211b028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:14.010165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd188f-1593-47a4-b2ab-93c79211b028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.011904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd188f-1593-47a4-b2ab-93c79211b028 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.013408 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30a6da-2f6c-4e73-8a93-7a3dd65e361a None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.018292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a27f88-961f-499d-ae14-9b5bbd407143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.019182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a27f88-961f-499d-ae14-9b5bbd407143 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.019675 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a27f88-961f-499d-ae14-9b5bbd407143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.020154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a27f88-961f-499d-ae14-9b5bbd407143 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.021054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a27f88-961f-499d-ae14-9b5bbd407143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:14.021377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a27f88-961f-499d-ae14-9b5bbd407143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.022404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: WARNING py.warnings [None req-13a27f88-961f-499d-ae14-9b5bbd407143 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 12:06:14.022404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: warnings.warn(msg) May 17 12:06:14.022404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: May 17 12:06:14.023281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a27f88-961f-499d-ae14-9b5bbd407143 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.024135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 771/1548] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:14.031758 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682baab-765b-48b7-950a-7b0318857b90 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.031758 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682baab-765b-48b7-950a-7b0318857b90 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.031758 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682baab-765b-48b7-950a-7b0318857b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.036486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 778/1549] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:14.043235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69503061-f2af-429d-a1f6-a7e9d8d30918 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.043678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69503061-f2af-429d-a1f6-a7e9d8d30918 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.043972 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69503061-f2af-429d-a1f6-a7e9d8d30918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.045584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-7682baab-765b-48b7-950a-7b0318857b90 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:14.046766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-7682baab-765b-48b7-950a-7b0318857b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:14.055100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 772/1550] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:14.057251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82b980-7c5e-4aa4-a633-409733ea3daa None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.057541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82b980-7c5e-4aa4-a633-409733ea3daa None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.057819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82b980-7c5e-4aa4-a633-409733ea3daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.063507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-69503061-f2af-429d-a1f6-a7e9d8d30918 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:14.064975 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-69503061-f2af-429d-a1f6-a7e9d8d30918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:14.073835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 779/1551] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:14.074812 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69503061-f2af-429d-a1f6-a7e9d8d30918 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.084228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69503061-f2af-429d-a1f6-a7e9d8d30918 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.087322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-bf82b980-7c5e-4aa4-a633-409733ea3daa None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:14.088744 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-bf82b980-7c5e-4aa4-a633-409733ea3daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:14.088962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e401e2d-484d-47ed-8bd7-38de395bdc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.089633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e401e2d-484d-47ed-8bd7-38de395bdc36 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.089918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e401e2d-484d-47ed-8bd7-38de395bdc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.090227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e401e2d-484d-47ed-8bd7-38de395bdc36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.090932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e401e2d-484d-47ed-8bd7-38de395bdc36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:14.091241 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e401e2d-484d-47ed-8bd7-38de395bdc36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.092903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e401e2d-484d-47ed-8bd7-38de395bdc36 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.098256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 773/1552] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:14.099170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82b980-7c5e-4aa4-a633-409733ea3daa None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.106405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 780/1553] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:14.107417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e401e2d-484d-47ed-8bd7-38de395bdc36 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.108857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82b980-7c5e-4aa4-a633-409733ea3daa None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.113482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e08d5f-f420-4005-8c52-6d638f02b6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.114139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08d5f-f420-4005-8c52-6d638f02b6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.114420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08d5f-f420-4005-8c52-6d638f02b6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.114692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08d5f-f420-4005-8c52-6d638f02b6c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.115414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e08d5f-f420-4005-8c52-6d638f02b6c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:14.115722 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e08d5f-f420-4005-8c52-6d638f02b6c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.116798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e401e2d-484d-47ed-8bd7-38de395bdc36 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.117352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e08d5f-f420-4005-8c52-6d638f02b6c7 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.122484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48531ec-ba91-43a1-a30e-43cbdf4e164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.123127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48531ec-ba91-43a1-a30e-43cbdf4e164f admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.123414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48531ec-ba91-43a1-a30e-43cbdf4e164f admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.123693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48531ec-ba91-43a1-a30e-43cbdf4e164f admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.124408 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48531ec-ba91-43a1-a30e-43cbdf4e164f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.126316 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48531ec-ba91-43a1-a30e-43cbdf4e164f admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.129462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 774/1554] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:14.132230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e08d5f-f420-4005-8c52-6d638f02b6c7 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.140010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e08d5f-f420-4005-8c52-6d638f02b6c7 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.144818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7bc38-be8f-4edd-a612-22a607ef486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.145459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7bc38-be8f-4edd-a612-22a607ef486b admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.145857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7bc38-be8f-4edd-a612-22a607ef486b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.146115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7bc38-be8f-4edd-a612-22a607ef486b admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.146844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7bc38-be8f-4edd-a612-22a607ef486b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.147899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: WARNING py.warnings [None req-79e7bc38-be8f-4edd-a612-22a607ef486b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 12:06:14.147899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: warnings.warn(msg) May 17 12:06:14.147899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: May 17 12:06:14.149127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7bc38-be8f-4edd-a612-22a607ef486b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.156491 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 781/1555] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.156491 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211be03f-7a6b-42e1-a737-e52586e5c516 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.156491 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211be03f-7a6b-42e1-a737-e52586e5c516 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.156491 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211be03f-7a6b-42e1-a737-e52586e5c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.173666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-211be03f-7a6b-42e1-a737-e52586e5c516 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:14.174869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-211be03f-7a6b-42e1-a737-e52586e5c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:14.179256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 775/1556] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.181150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3ab66-3e05-4a98-ad54-888d1df6ac37 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.181663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3ab66-3e05-4a98-ad54-888d1df6ac37 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.182030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3ab66-3e05-4a98-ad54-888d1df6ac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.198913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-6fe3ab66-3e05-4a98-ad54-888d1df6ac37 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:14.200111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6fe3ab66-3e05-4a98-ad54-888d1df6ac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:14.233080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 782/1557] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:14.234450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065d16a-00c2-4e7a-b687-9b5a542e38da None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.234742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065d16a-00c2-4e7a-b687-9b5a542e38da None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.235018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065d16a-00c2-4e7a-b687-9b5a542e38da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.253597 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-6065d16a-00c2-4e7a-b687-9b5a542e38da None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:14.254834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6065d16a-00c2-4e7a-b687-9b5a542e38da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:14.260713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 776/1558] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:14.261995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b360ea-f583-4a44-aecc-63ca28e5ff44 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.262284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b360ea-f583-4a44-aecc-63ca28e5ff44 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.262561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b360ea-f583-4a44-aecc-63ca28e5ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.263141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 783/1559] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:14.263756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065d16a-00c2-4e7a-b687-9b5a542e38da None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.275634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065d16a-00c2-4e7a-b687-9b5a542e38da None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.280471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cf850-2a9c-4f01-9422-23610a41149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.281117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cf850-2a9c-4f01-9422-23610a41149c admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.281398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cf850-2a9c-4f01-9422-23610a41149c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.281669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cf850-2a9c-4f01-9422-23610a41149c admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.282343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cf850-2a9c-4f01-9422-23610a41149c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.282865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-10b360ea-f583-4a44-aecc-63ca28e5ff44 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:14.284043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-10b360ea-f583-4a44-aecc-63ca28e5ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:14.284260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cf850-2a9c-4f01-9422-23610a41149c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.292588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 777/1560] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:14.293325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b360ea-f583-4a44-aecc-63ca28e5ff44 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.302345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b360ea-f583-4a44-aecc-63ca28e5ff44 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.307999 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02374-b6cf-4dfa-b389-bfe474db9dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.308682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02374-b6cf-4dfa-b389-bfe474db9dfd admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.308962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02374-b6cf-4dfa-b389-bfe474db9dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.309239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c02374-b6cf-4dfa-b389-bfe474db9dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.309914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c02374-b6cf-4dfa-b389-bfe474db9dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.314619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 784/1561] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.314770 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c02374-b6cf-4dfa-b389-bfe474db9dfd admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.314876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cf850-2a9c-4f01-9422-23610a41149c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.340294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 778/1562] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.341121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02374-b6cf-4dfa-b389-bfe474db9dfd admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.377521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cf850-2a9c-4f01-9422-23610a41149c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.401670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c02374-b6cf-4dfa-b389-bfe474db9dfd admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.406262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a2d34-0121-4121-8ff1-811ed03f8b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.406968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a2d34-0121-4121-8ff1-811ed03f8b62 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.407266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a2d34-0121-4121-8ff1-811ed03f8b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.407546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a2d34-0121-4121-8ff1-811ed03f8b62 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.408255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a2d34-0121-4121-8ff1-811ed03f8b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.410191 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a2d34-0121-4121-8ff1-811ed03f8b62 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.430535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 779/1563] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.432121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a2d34-0121-4121-8ff1-811ed03f8b62 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.433031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d92199-4ef2-41e6-92a6-e64a5da4c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.433717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d92199-4ef2-41e6-92a6-e64a5da4c3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.433983 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d92199-4ef2-41e6-92a6-e64a5da4c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.434494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d92199-4ef2-41e6-92a6-e64a5da4c3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.435189 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d92199-4ef2-41e6-92a6-e64a5da4c3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.436228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: WARNING py.warnings [None req-26d92199-4ef2-41e6-92a6-e64a5da4c3b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 12:06:14.436228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: warnings.warn(msg) May 17 12:06:14.436228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: May 17 12:06:14.437423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d92199-4ef2-41e6-92a6-e64a5da4c3b8 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.441487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a2d34-0121-4121-8ff1-811ed03f8b62 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.447165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b5e37-b4d6-49f8-80e5-e5f54730ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.447498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b5e37-b4d6-49f8-80e5-e5f54730ee53 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.447775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b5e37-b4d6-49f8-80e5-e5f54730ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.448055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b5e37-b4d6-49f8-80e5-e5f54730ee53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.448829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b5e37-b4d6-49f8-80e5-e5f54730ee53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:14.449107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b5e37-b4d6-49f8-80e5-e5f54730ee53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.450725 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b5e37-b4d6-49f8-80e5-e5f54730ee53 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.459090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 785/1564] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.460097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d92199-4ef2-41e6-92a6-e64a5da4c3b8 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.464212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 780/1565] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:14.465543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67131b-94e4-4759-93fa-7175bf16611e None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.465836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67131b-94e4-4759-93fa-7175bf16611e None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.466129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67131b-94e4-4759-93fa-7175bf16611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.470385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d92199-4ef2-41e6-92a6-e64a5da4c3b8 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.475109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fe559-a126-4e04-894b-280e3b014197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.475761 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe559-a126-4e04-894b-280e3b014197 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.476042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe559-a126-4e04-894b-280e3b014197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.476344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe559-a126-4e04-894b-280e3b014197 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.477064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fe559-a126-4e04-894b-280e3b014197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:14.477481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fe559-a126-4e04-894b-280e3b014197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.479096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fe559-a126-4e04-894b-280e3b014197 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.483202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-9a67131b-94e4-4759-93fa-7175bf16611e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:14.484424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9a67131b-94e4-4759-93fa-7175bf16611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:14.491039 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 786/1566] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:14.491604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fe559-a126-4e04-894b-280e3b014197 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.492322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 781/1567] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:14.495809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67131b-94e4-4759-93fa-7175bf16611e None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.502741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67131b-94e4-4759-93fa-7175bf16611e None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.506948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fe559-a126-4e04-894b-280e3b014197 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.507258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cf662-9f24-4103-9a37-3760e7de4fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.507923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf662-9f24-4103-9a37-3760e7de4fcc admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.508240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf662-9f24-4103-9a37-3760e7de4fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.508524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf662-9f24-4103-9a37-3760e7de4fcc admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.509900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cf662-9f24-4103-9a37-3760e7de4fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.511842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cf662-9f24-4103-9a37-3760e7de4fcc admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.512064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a7894-7ca1-47d9-b072-fc39b50fcd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.512733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a7894-7ca1-47d9-b072-fc39b50fcd19 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.513010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a7894-7ca1-47d9-b072-fc39b50fcd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.513279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a7894-7ca1-47d9-b072-fc39b50fcd19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.513990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a7894-7ca1-47d9-b072-fc39b50fcd19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:14.514292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a7894-7ca1-47d9-b072-fc39b50fcd19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.515849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a7894-7ca1-47d9-b072-fc39b50fcd19 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.527820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 787/1568] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:14.534909 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a7894-7ca1-47d9-b072-fc39b50fcd19 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.539508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 782/1569] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.539508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cf662-9f24-4103-9a37-3760e7de4fcc admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.539743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a7894-7ca1-47d9-b072-fc39b50fcd19 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.544748 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40929b95-231c-4f38-a950-5b2e13b1d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.545511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40929b95-231c-4f38-a950-5b2e13b1d987 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.545691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40929b95-231c-4f38-a950-5b2e13b1d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.545960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40929b95-231c-4f38-a950-5b2e13b1d987 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.546639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40929b95-231c-4f38-a950-5b2e13b1d987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.548269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cf662-9f24-4103-9a37-3760e7de4fcc admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.548614 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40929b95-231c-4f38-a950-5b2e13b1d987 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.553479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be87d4-a399-489e-835a-ec62955f9c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.554134 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be87d4-a399-489e-835a-ec62955f9c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.554419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be87d4-a399-489e-835a-ec62955f9c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.554693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be87d4-a399-489e-835a-ec62955f9c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.555416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be87d4-a399-489e-835a-ec62955f9c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.557766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be87d4-a399-489e-835a-ec62955f9c33 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.569060 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 783/1570] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:14.572660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 788/1571] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.572801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be87d4-a399-489e-835a-ec62955f9c33 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.572914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40929b95-231c-4f38-a950-5b2e13b1d987 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.580718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40929b95-231c-4f38-a950-5b2e13b1d987 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.581875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be87d4-a399-489e-835a-ec62955f9c33 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.585236 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af26d-765e-404e-ac7a-5b1e9bba4b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.585879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af26d-765e-404e-ac7a-5b1e9bba4b53 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.586166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af26d-765e-404e-ac7a-5b1e9bba4b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.586445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af26d-765e-404e-ac7a-5b1e9bba4b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.587006 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3fe9-a190-498d-bd84-311c492082b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.587143 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642af26d-765e-404e-ac7a-5b1e9bba4b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.587656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3fe9-a190-498d-bd84-311c492082b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.587947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3fe9-a190-498d-bd84-311c492082b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.588262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3fe9-a190-498d-bd84-311c492082b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.588990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf3fe9-a190-498d-bd84-311c492082b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.589099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642af26d-765e-404e-ac7a-5b1e9bba4b53 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.590630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf3fe9-a190-498d-bd84-311c492082b2 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.600549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 784/1572] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:14.601436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3fe9-a190-498d-bd84-311c492082b2 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.612296 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3fe9-a190-498d-bd84-311c492082b2 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.617062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674d1e-b664-4d16-94c4-65784a529ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.617720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674d1e-b664-4d16-94c4-65784a529ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.618004 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674d1e-b664-4d16-94c4-65784a529ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.618825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d674d1e-b664-4d16-94c4-65784a529ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.618932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 789/1573] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.622234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d674d1e-b664-4d16-94c4-65784a529ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:14.622234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d674d1e-b664-4d16-94c4-65784a529ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.622446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af26d-765e-404e-ac7a-5b1e9bba4b53 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.622537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d674d1e-b664-4d16-94c4-65784a529ef8 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.634429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 785/1574] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:14.635268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674d1e-b664-4d16-94c4-65784a529ef8 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.644760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d674d1e-b664-4d16-94c4-65784a529ef8 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.682250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af26d-765e-404e-ac7a-5b1e9bba4b53 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.686998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df78cd9-d309-427a-87fb-35fd12b031e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.687662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df78cd9-d309-427a-87fb-35fd12b031e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.687951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df78cd9-d309-427a-87fb-35fd12b031e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.688261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df78cd9-d309-427a-87fb-35fd12b031e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.688952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df78cd9-d309-427a-87fb-35fd12b031e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.690868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df78cd9-d309-427a-87fb-35fd12b031e7 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.699299 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7bb1-0400-4190-ba2c-117fb92413ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.700043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7bb1-0400-4190-ba2c-117fb92413ee admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.700412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7bb1-0400-4190-ba2c-117fb92413ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.700698 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7bb1-0400-4190-ba2c-117fb92413ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.701386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7bb1-0400-4190-ba2c-117fb92413ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.703326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7bb1-0400-4190-ba2c-117fb92413ee admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.719352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 790/1575] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.719352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df78cd9-d309-427a-87fb-35fd12b031e7 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.731841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 786/1576] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.735956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7bb1-0400-4190-ba2c-117fb92413ee admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.781607 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df78cd9-d309-427a-87fb-35fd12b031e7 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.795196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7bb1-0400-4190-ba2c-117fb92413ee admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.799779 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39c389-6d43-4f34-9a98-924ae431d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.800472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39c389-6d43-4f34-9a98-924ae431d49f admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.800759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39c389-6d43-4f34-9a98-924ae431d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.801038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39c389-6d43-4f34-9a98-924ae431d49f admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.801760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39c389-6d43-4f34-9a98-924ae431d49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.803477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39c389-6d43-4f34-9a98-924ae431d49f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.813182 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 787/1577] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:14.813985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39c389-6d43-4f34-9a98-924ae431d49f admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.823590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39c389-6d43-4f34-9a98-924ae431d49f admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.828369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a9427-b190-4b41-9b13-5e5be6351947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.829010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a9427-b190-4b41-9b13-5e5be6351947 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.829287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a9427-b190-4b41-9b13-5e5be6351947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.829558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a9427-b190-4b41-9b13-5e5be6351947 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.830265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a9427-b190-4b41-9b13-5e5be6351947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.831859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a9427-b190-4b41-9b13-5e5be6351947 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.836282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c54c2-fa77-469b-85ef-a669f044606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.837473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c54c2-fa77-469b-85ef-a669f044606a admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.837959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c54c2-fa77-469b-85ef-a669f044606a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.838315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c54c2-fa77-469b-85ef-a669f044606a admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.839050 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c54c2-fa77-469b-85ef-a669f044606a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.840685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c54c2-fa77-469b-85ef-a669f044606a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.842257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 788/1578] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:14.842257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a9427-b190-4b41-9b13-5e5be6351947 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.850622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 791/1579] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:14.851388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c54c2-fa77-469b-85ef-a669f044606a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.853836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a9427-b190-4b41-9b13-5e5be6351947 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.858339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec3c8-5d3c-482a-8283-2a630de936a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.858990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec3c8-5d3c-482a-8283-2a630de936a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.859274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec3c8-5d3c-482a-8283-2a630de936a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.859560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec3c8-5d3c-482a-8283-2a630de936a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.860317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acec3c8-5d3c-482a-8283-2a630de936a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.861759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c54c2-fa77-469b-85ef-a669f044606a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.861876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acec3c8-5d3c-482a-8283-2a630de936a4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.866298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e723-223e-45c4-9360-31609f87833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.866943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e723-223e-45c4-9360-31609f87833b admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.867230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e723-223e-45c4-9360-31609f87833b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.867509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e723-223e-45c4-9360-31609f87833b admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.868242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524e723-223e-45c4-9360-31609f87833b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.870145 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524e723-223e-45c4-9360-31609f87833b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.872799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 789/1580] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:14.873570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec3c8-5d3c-482a-8283-2a630de936a4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.882847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec3c8-5d3c-482a-8283-2a630de936a4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.889163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2360a-2548-4778-91c8-372c92937acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.889810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2360a-2548-4778-91c8-372c92937acc admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.890090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2360a-2548-4778-91c8-372c92937acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.890237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 792/1581] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/users => generated 296 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.890361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2360a-2548-4778-91c8-372c92937acc admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.891041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2360a-2548-4778-91c8-372c92937acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.891245 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e723-223e-45c4-9360-31609f87833b admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.893008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2360a-2548-4778-91c8-372c92937acc admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.903037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e723-223e-45c4-9360-31609f87833b admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.909096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246a68e-af64-48eb-9b0b-4bbf2aebe3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.910452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246a68e-af64-48eb-9b0b-4bbf2aebe3bb admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.911078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246a68e-af64-48eb-9b0b-4bbf2aebe3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.911726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246a68e-af64-48eb-9b0b-4bbf2aebe3bb admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:14.913096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246a68e-af64-48eb-9b0b-4bbf2aebe3bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:14.917511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246a68e-af64-48eb-9b0b-4bbf2aebe3bb admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:14.928094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 790/1582] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.928094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2360a-2548-4778-91c8-372c92937acc admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.938633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 793/1583] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:14.939919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246a68e-af64-48eb-9b0b-4bbf2aebe3bb admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:14.949548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246a68e-af64-48eb-9b0b-4bbf2aebe3bb admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.993899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2360a-2548-4778-91c8-372c92937acc admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:14.998516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b0a9f-6cb1-485b-a4a3-add26146a9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:14.999313 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0a9f-6cb1-485b-a4a3-add26146a9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:14.999597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0a9f-6cb1-485b-a4a3-add26146a9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:14.999868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0a9f-6cb1-485b-a4a3-add26146a9e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.000574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b0a9f-6cb1-485b-a4a3-add26146a9e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.002468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b0a9f-6cb1-485b-a4a3-add26146a9e7 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.005341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5ab4f-2711-4dbf-b8b8-9c6fb0f3bfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.006227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ab4f-2711-4dbf-b8b8-9c6fb0f3bfb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.006513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ab4f-2711-4dbf-b8b8-9c6fb0f3bfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.006793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ab4f-2711-4dbf-b8b8-9c6fb0f3bfb1 admin admin] PATH_INFO: `/v3/projects/21dae19410e148c5b90ea66f5d658452/users/2b1f12a32d3b478b999a91d242fed3c2/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.022628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5ab4f-2711-4dbf-b8b8-9c6fb0f3bfb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21dae19410e148c5b90ea66f5d658452, user_id=2b1f12a32d3b478b999a91d242fed3c2, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.022826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 791/1584] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:14 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:15.026511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5ab4f-2711-4dbf-b8b8-9c6fb0f3bfb1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.027015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b0a9f-6cb1-485b-a4a3-add26146a9e7 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.036376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b0a9f-6cb1-485b-a4a3-add26146a9e7 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.039669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 794/1585] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:14 2022] PUT /identity/v3/projects/21dae19410e148c5b90ea66f5d658452/users/2b1f12a32d3b478b999a91d242fed3c2/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:15.041288 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5ab4f-2711-4dbf-b8b8-9c6fb0f3bfb1 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.093194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa863a6-fa8b-40f5-8439-7649ce1709f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.093779 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa863a6-fa8b-40f5-8439-7649ce1709f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.094062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa863a6-fa8b-40f5-8439-7649ce1709f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.094339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa863a6-fa8b-40f5-8439-7649ce1709f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.095064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa863a6-fa8b-40f5-8439-7649ce1709f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.096694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa863a6-fa8b-40f5-8439-7649ce1709f9 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.102429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5ab4f-2711-4dbf-b8b8-9c6fb0f3bfb1 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.106285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 792/1586] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:15.107131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa863a6-fa8b-40f5-8439-7649ce1709f9 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.108270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6dd5a-2a1c-46bd-a077-a503a18330db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.108949 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6dd5a-2a1c-46bd-a077-a503a18330db admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.109336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6dd5a-2a1c-46bd-a077-a503a18330db admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.109622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6dd5a-2a1c-46bd-a077-a503a18330db admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.110360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6dd5a-2a1c-46bd-a077-a503a18330db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.112043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6dd5a-2a1c-46bd-a077-a503a18330db admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.116510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa863a6-fa8b-40f5-8439-7649ce1709f9 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.122249 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab593e-8e11-416f-9eae-bca91616e53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.125638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 795/1587] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:15.125789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab593e-8e11-416f-9eae-bca91616e53b admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.125789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab593e-8e11-416f-9eae-bca91616e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.125991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6dd5a-2a1c-46bd-a077-a503a18330db admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.126082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab593e-8e11-416f-9eae-bca91616e53b admin admin] PATH_INFO: `/v3/projects/2ae797920785457f975f9f85d80849af/users/79ff688720854ad1b62b3c9b51546e0f/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.134332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6dd5a-2a1c-46bd-a077-a503a18330db admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.138926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b34f3-5f7f-4d82-9647-bf944efe30e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.139077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab593e-8e11-416f-9eae-bca91616e53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae797920785457f975f9f85d80849af, user_id=79ff688720854ad1b62b3c9b51546e0f, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.139849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b34f3-5f7f-4d82-9647-bf944efe30e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.140109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: WARNING py.warnings [None req-06ab593e-8e11-416f-9eae-bca91616e53b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 12:06:15.140109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: warnings.warn(msg) May 17 12:06:15.140109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: May 17 12:06:15.140586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b34f3-5f7f-4d82-9647-bf944efe30e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.140586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b34f3-5f7f-4d82-9647-bf944efe30e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.141147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b34f3-5f7f-4d82-9647-bf944efe30e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.142080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab593e-8e11-416f-9eae-bca91616e53b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.142800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b34f3-5f7f-4d82-9647-bf944efe30e9 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.153839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 796/1588] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:15.154719 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b34f3-5f7f-4d82-9647-bf944efe30e9 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.155559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 793/1589] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:15 2022] PUT /identity/v3/projects/2ae797920785457f975f9f85d80849af/users/79ff688720854ad1b62b3c9b51546e0f/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:15.156120 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab593e-8e11-416f-9eae-bca91616e53b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.164691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b34f3-5f7f-4d82-9647-bf944efe30e9 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.217327 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab593e-8e11-416f-9eae-bca91616e53b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.219698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258bd30-e5b8-4910-9c3d-01aec04ec397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.220650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258bd30-e5b8-4910-9c3d-01aec04ec397 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.221042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258bd30-e5b8-4910-9c3d-01aec04ec397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.221447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258bd30-e5b8-4910-9c3d-01aec04ec397 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.221988 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470e30-923c-471b-b815-d111330bc304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.222395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258bd30-e5b8-4910-9c3d-01aec04ec397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.222654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470e30-923c-471b-b815-d111330bc304 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.222940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470e30-923c-471b-b815-d111330bc304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.223216 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470e30-923c-471b-b815-d111330bc304 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.223953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b470e30-923c-471b-b815-d111330bc304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.225015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258bd30-e5b8-4910-9c3d-01aec04ec397 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.225570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b470e30-923c-471b-b815-d111330bc304 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.235772 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 794/1590] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:15.235772 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470e30-923c-471b-b815-d111330bc304 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.247746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470e30-923c-471b-b815-d111330bc304 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.247930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 797/1591] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:15 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:15.249266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becad0dc-083b-4d24-8d08-a199906b82b7 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.249647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becad0dc-083b-4d24-8d08-a199906b82b7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.249947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becad0dc-083b-4d24-8d08-a199906b82b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.255787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d720d-390c-45f8-9552-e885b152ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.256480 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d720d-390c-45f8-9552-e885b152ec7b admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.256771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d720d-390c-45f8-9552-e885b152ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.257051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d720d-390c-45f8-9552-e885b152ec7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.257778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d720d-390c-45f8-9552-e885b152ec7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.259792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d720d-390c-45f8-9552-e885b152ec7b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.269814 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 795/1592] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:15.270673 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d720d-390c-45f8-9552-e885b152ec7b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.279802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-becad0dc-083b-4d24-8d08-a199906b82b7 None None] MFA Rules not processed for user `2b1f12a32d3b478b999a91d242fed3c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:15.280839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d720d-390c-45f8-9552-e885b152ec7b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.281134 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-becad0dc-083b-4d24-8d08-a199906b82b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:15.285360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073321c7-d474-42ba-a5ff-8b779a81ec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.286226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073321c7-d474-42ba-a5ff-8b779a81ec65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.286508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073321c7-d474-42ba-a5ff-8b779a81ec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.286789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073321c7-d474-42ba-a5ff-8b779a81ec65 admin admin] PATH_INFO: `/v3/projects/672159344e2c4ecbb0b633aa9606a119/users/2c48fb9b327045ed9236bea1ef6cdd73/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.301554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073321c7-d474-42ba-a5ff-8b779a81ec65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672159344e2c4ecbb0b633aa9606a119, user_id=2c48fb9b327045ed9236bea1ef6cdd73, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.304262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073321c7-d474-42ba-a5ff-8b779a81ec65 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.317595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 796/1593] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:15 2022] PUT /identity/v3/projects/672159344e2c4ecbb0b633aa9606a119/users/2c48fb9b327045ed9236bea1ef6cdd73/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:15.318750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073321c7-d474-42ba-a5ff-8b779a81ec65 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.346403 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 798/1594] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:15.347168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becad0dc-083b-4d24-8d08-a199906b82b7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.358953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becad0dc-083b-4d24-8d08-a199906b82b7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.379817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073321c7-d474-42ba-a5ff-8b779a81ec65 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.385001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ba1d1-494e-41e3-926b-be6a7a1f0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.385894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ba1d1-494e-41e3-926b-be6a7a1f0d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.386179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ba1d1-494e-41e3-926b-be6a7a1f0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.386459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ba1d1-494e-41e3-926b-be6a7a1f0d48 admin admin] PATH_INFO: `/v3/projects/cd2c9994923540748c1513406e3e7ffc/users/e8a6a76a94ca4fb197c7b1705b809c54/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.400852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ba1d1-494e-41e3-926b-be6a7a1f0d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2c9994923540748c1513406e3e7ffc, user_id=e8a6a76a94ca4fb197c7b1705b809c54, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.403505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ba1d1-494e-41e3-926b-be6a7a1f0d48 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.413507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d339e2-8bfc-4bbb-8ef9-ceba3a05ff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.414239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d339e2-8bfc-4bbb-8ef9-ceba3a05ff0e admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.414528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d339e2-8bfc-4bbb-8ef9-ceba3a05ff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.414802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d339e2-8bfc-4bbb-8ef9-ceba3a05ff0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.416125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d339e2-8bfc-4bbb-8ef9-ceba3a05ff0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.417148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 797/1595] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:15 2022] PUT /identity/v3/projects/cd2c9994923540748c1513406e3e7ffc/users/e8a6a76a94ca4fb197c7b1705b809c54/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:15.418621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cfdef-fea5-44d2-b214-336b24b0067d None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.418909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cfdef-fea5-44d2-b214-336b24b0067d None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.419189 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cfdef-fea5-44d2-b214-336b24b0067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.420882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d339e2-8bfc-4bbb-8ef9-ceba3a05ff0e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.434589 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 799/1596] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:15.434589 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d339e2-8bfc-4bbb-8ef9-ceba3a05ff0e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.435592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a03cfdef-fea5-44d2-b214-336b24b0067d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:15.436796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a03cfdef-fea5-44d2-b214-336b24b0067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:15.441878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d339e2-8bfc-4bbb-8ef9-ceba3a05ff0e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.493692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 798/1597] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:15.496831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662575b-26fa-45a7-b8b0-6db56dd5c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.498458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cfdef-fea5-44d2-b214-336b24b0067d None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.499012 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662575b-26fa-45a7-b8b0-6db56dd5c2fd admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.499291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662575b-26fa-45a7-b8b0-6db56dd5c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.499569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662575b-26fa-45a7-b8b0-6db56dd5c2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.500333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662575b-26fa-45a7-b8b0-6db56dd5c2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.501960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662575b-26fa-45a7-b8b0-6db56dd5c2fd admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.510744 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cfdef-fea5-44d2-b214-336b24b0067d None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.513138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 800/1598] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:15.513956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662575b-26fa-45a7-b8b0-6db56dd5c2fd admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.517886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06808cf5-0e26-4ae0-b740-31b83a529fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.518547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06808cf5-0e26-4ae0-b740-31b83a529fce admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.518831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06808cf5-0e26-4ae0-b740-31b83a529fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.519104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06808cf5-0e26-4ae0-b740-31b83a529fce admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.519827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06808cf5-0e26-4ae0-b740-31b83a529fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.521461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06808cf5-0e26-4ae0-b740-31b83a529fce admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.525298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662575b-26fa-45a7-b8b0-6db56dd5c2fd admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.531117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a872942-f90b-4a26-8cb9-6ccbdfee2a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.532006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872942-f90b-4a26-8cb9-6ccbdfee2a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.532481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872942-f90b-4a26-8cb9-6ccbdfee2a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.532592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 799/1599] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:15.532996 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872942-f90b-4a26-8cb9-6ccbdfee2a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.533872 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a872942-f90b-4a26-8cb9-6ccbdfee2a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.533997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37e2c2-27a7-4f55-95ae-6ee86ed1c5e4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.534173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37e2c2-27a7-4f55-95ae-6ee86ed1c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.534449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37e2c2-27a7-4f55-95ae-6ee86ed1c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.536100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a872942-f90b-4a26-8cb9-6ccbdfee2a89 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.547230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 801/1600] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:15.548037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a872942-f90b-4a26-8cb9-6ccbdfee2a89 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.554397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4b37e2c2-27a7-4f55-95ae-6ee86ed1c5e4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:15.555571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4b37e2c2-27a7-4f55-95ae-6ee86ed1c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:15.564212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 800/1601] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:15.565295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f1274-9868-40fe-9f86-cdcfa1b382b7 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.565499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a872942-f90b-4a26-8cb9-6ccbdfee2a89 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.565658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f1274-9868-40fe-9f86-cdcfa1b382b7 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.565847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f1274-9868-40fe-9f86-cdcfa1b382b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.570463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3436e7-b8dd-47e3-a7d3-a605146a1522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.571254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3436e7-b8dd-47e3-a7d3-a605146a1522 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.572464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3436e7-b8dd-47e3-a7d3-a605146a1522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.573125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3436e7-b8dd-47e3-a7d3-a605146a1522 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.574423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3436e7-b8dd-47e3-a7d3-a605146a1522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.576449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3436e7-b8dd-47e3-a7d3-a605146a1522 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.583488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-742f1274-9868-40fe-9f86-cdcfa1b382b7 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:15.584693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-742f1274-9868-40fe-9f86-cdcfa1b382b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:15.592263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 801/1602] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:15.593059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f1274-9868-40fe-9f86-cdcfa1b382b7 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.603672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f1274-9868-40fe-9f86-cdcfa1b382b7 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.605916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 802/1603] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:15 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:15.606631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3436e7-b8dd-47e3-a7d3-a605146a1522 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.611353 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa22c3-5640-4673-8e8f-27aa0c4ebe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.612294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa22c3-5640-4673-8e8f-27aa0c4ebe93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.612578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa22c3-5640-4673-8e8f-27aa0c4ebe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.612858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa22c3-5640-4673-8e8f-27aa0c4ebe93 admin admin] PATH_INFO: `/v3/projects/748d013ae6664fc79a9ac23e58f642e5/users/bb9da9200f804a4a987f2cdb49f6801d/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.627763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa22c3-5640-4673-8e8f-27aa0c4ebe93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748d013ae6664fc79a9ac23e58f642e5, user_id=bb9da9200f804a4a987f2cdb49f6801d, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.630489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa22c3-5640-4673-8e8f-27aa0c4ebe93 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.643444 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 802/1604] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:15 2022] PUT /identity/v3/projects/748d013ae6664fc79a9ac23e58f642e5/users/bb9da9200f804a4a987f2cdb49f6801d/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:15.647313 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa22c3-5640-4673-8e8f-27aa0c4ebe93 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.662279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3436e7-b8dd-47e3-a7d3-a605146a1522 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.705011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa22c3-5640-4673-8e8f-27aa0c4ebe93 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.709613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b6c47-85e2-491a-b2c3-584f5ba195a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.710287 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc31286-91ee-4078-b762-fbfe8bf1bf89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.710496 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b6c47-85e2-491a-b2c3-584f5ba195a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.710775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b6c47-85e2-491a-b2c3-584f5ba195a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.710938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31286-91ee-4078-b762-fbfe8bf1bf89 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.711043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b6c47-85e2-491a-b2c3-584f5ba195a4 admin admin] PATH_INFO: `/v3/projects/b24cd1a360fe4f798dc75cdcdc79ab4b/users/ca5437b5c23049a9b9d116f84665c9e2/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.711225 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31286-91ee-4078-b762-fbfe8bf1bf89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.711505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31286-91ee-4078-b762-fbfe8bf1bf89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.720778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc31286-91ee-4078-b762-fbfe8bf1bf89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.722223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc31286-91ee-4078-b762-fbfe8bf1bf89 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.724945 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b6c47-85e2-491a-b2c3-584f5ba195a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24cd1a360fe4f798dc75cdcdc79ab4b, user_id=ca5437b5c23049a9b9d116f84665c9e2, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.727590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b6c47-85e2-491a-b2c3-584f5ba195a4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.732121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 803/1605] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:15.733092 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc31286-91ee-4078-b762-fbfe8bf1bf89 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.752572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 803/1606] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:15 2022] PUT /identity/v3/projects/b24cd1a360fe4f798dc75cdcdc79ab4b/users/ca5437b5c23049a9b9d116f84665c9e2/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:15.752803 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc31286-91ee-4078-b762-fbfe8bf1bf89 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.752907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b6c47-85e2-491a-b2c3-584f5ba195a4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.814185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e99b37-9ac8-4ec5-9cb0-89a187842063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.815356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e99b37-9ac8-4ec5-9cb0-89a187842063 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.815849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e99b37-9ac8-4ec5-9cb0-89a187842063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.816139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e99b37-9ac8-4ec5-9cb0-89a187842063 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.817002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e99b37-9ac8-4ec5-9cb0-89a187842063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.819047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e99b37-9ac8-4ec5-9cb0-89a187842063 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.819331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b6c47-85e2-491a-b2c3-584f5ba195a4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.827904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44263bc-fabc-4fc5-a561-6d456dca32bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.828988 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44263bc-fabc-4fc5-a561-6d456dca32bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.829387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44263bc-fabc-4fc5-a561-6d456dca32bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.829840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44263bc-fabc-4fc5-a561-6d456dca32bf admin admin] PATH_INFO: `/v3/projects/e7418bc2e2fd419a9bd526f8c443d044/users/afa1d6f88acf47dda13d4fd7ea891fc8/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.831181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 804/1607] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:15.832062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e99b37-9ac8-4ec5-9cb0-89a187842063 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.854769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44263bc-fabc-4fc5-a561-6d456dca32bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7418bc2e2fd419a9bd526f8c443d044, user_id=afa1d6f88acf47dda13d4fd7ea891fc8, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:15.859347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44263bc-fabc-4fc5-a561-6d456dca32bf admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:15.877631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 804/1608] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:15 2022] PUT /identity/v3/projects/e7418bc2e2fd419a9bd526f8c443d044/users/afa1d6f88acf47dda13d4fd7ea891fc8/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:15.878864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44263bc-fabc-4fc5-a561-6d456dca32bf admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:15.898374 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e99b37-9ac8-4ec5-9cb0-89a187842063 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.944372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44263bc-fabc-4fc5-a561-6d456dca32bf admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:15.948770 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cc77e-8146-4144-8e7e-499ae7e3a55b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.949539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cc77e-8146-4144-8e7e-499ae7e3a55b service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.949823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cc77e-8146-4144-8e7e-499ae7e3a55b service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.950099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cc77e-8146-4144-8e7e-499ae7e3a55b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:15.954586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f36413-7b7f-4ab4-a418-dc9e8be53a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:15.955378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36413-7b7f-4ab4-a418-dc9e8be53a43 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:15.956278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36413-7b7f-4ab4-a418-dc9e8be53a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:15.956652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f36413-7b7f-4ab4-a418-dc9e8be53a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.013939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cc77e-8146-4144-8e7e-499ae7e3a55b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.015772 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cc77e-8146-4144-8e7e-499ae7e3a55b service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.023157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f36413-7b7f-4ab4-a418-dc9e8be53a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.025291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f36413-7b7f-4ab4-a418-dc9e8be53a43 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.027033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 805/1609] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:16.029134 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cc77e-8146-4144-8e7e-499ae7e3a55b service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:16.035427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 805/1610] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:16.037123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab7760-9ff0-4aa8-a641-948e6c2255ce None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.037123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab7760-9ff0-4aa8-a641-948e6c2255ce None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.037532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab7760-9ff0-4aa8-a641-948e6c2255ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.042259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cc77e-8146-4144-8e7e-499ae7e3a55b service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:16.054854 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9a3e5-840e-4433-a2d9-5d80a2b18dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:16.056072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a3e5-840e-4433-a2d9-5d80a2b18dae admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.056793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a3e5-840e-4433-a2d9-5d80a2b18dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.057247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a3e5-840e-4433-a2d9-5d80a2b18dae admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.057368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-16ab7760-9ff0-4aa8-a641-948e6c2255ce None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:16.058952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9a3e5-840e-4433-a2d9-5d80a2b18dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.059208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-16ab7760-9ff0-4aa8-a641-948e6c2255ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:16.062129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9a3e5-840e-4433-a2d9-5d80a2b18dae admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.073978 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 806/1611] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:16.075398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8f868-6986-4817-8a46-607927ad427c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.075690 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8f868-6986-4817-8a46-607927ad427c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.075965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8f868-6986-4817-8a46-607927ad427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.093487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 806/1612] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:16 2022] POST /identity/v3/users => generated 290 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:16.093487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9a3e5-840e-4433-a2d9-5d80a2b18dae admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:16.101288 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9a3e5-840e-4433-a2d9-5d80a2b18dae admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:16.106957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12d1ed-1141-4c36-8e5e-aec485443de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:16.107623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12d1ed-1141-4c36-8e5e-aec485443de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.107910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12d1ed-1141-4c36-8e5e-aec485443de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.108242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12d1ed-1141-4c36-8e5e-aec485443de5 admin admin] PATH_INFO: `/v3/projects/27acd98621cd4a51ac46fb12e1824168/users/586e15d5d16543e6b70c87fbf9079e9e/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.118859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-b0e8f868-6986-4817-8a46-607927ad427c None None] MFA Rules not processed for user `ca5437b5c23049a9b9d116f84665c9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:16.120974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b0e8f868-6986-4817-8a46-607927ad427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:16.126915 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12d1ed-1141-4c36-8e5e-aec485443de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27acd98621cd4a51ac46fb12e1824168, user_id=586e15d5d16543e6b70c87fbf9079e9e, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.129778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12d1ed-1141-4c36-8e5e-aec485443de5 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.152738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 807/1613] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:16 2022] PUT /identity/v3/projects/27acd98621cd4a51ac46fb12e1824168/users/586e15d5d16543e6b70c87fbf9079e9e/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:16.154429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22214920-7110-4712-8e46-73f36767d422 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.154740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22214920-7110-4712-8e46-73f36767d422 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.155079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22214920-7110-4712-8e46-73f36767d422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.175198 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-22214920-7110-4712-8e46-73f36767d422 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:16.176787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-22214920-7110-4712-8e46-73f36767d422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:16.214792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 807/1614] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:16.215763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8f868-6986-4817-8a46-607927ad427c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:16.229578 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8f868-6986-4817-8a46-607927ad427c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:16.248513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 808/1615] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:16.248513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22214920-7110-4712-8e46-73f36767d422 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:16.256215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22214920-7110-4712-8e46-73f36767d422 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:16.261406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dabbff-82c4-4ead-a0e3-ff4eedeedf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:16.262080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dabbff-82c4-4ead-a0e3-ff4eedeedf1a admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.262364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dabbff-82c4-4ead-a0e3-ff4eedeedf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.262641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dabbff-82c4-4ead-a0e3-ff4eedeedf1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.263376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dabbff-82c4-4ead-a0e3-ff4eedeedf1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.265035 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dabbff-82c4-4ead-a0e3-ff4eedeedf1a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.277995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 809/1616] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:16.279636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8dfbb-be1c-42cf-8f35-95c3aa38b9e0 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.280042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8dfbb-be1c-42cf-8f35-95c3aa38b9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.280529 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8dfbb-be1c-42cf-8f35-95c3aa38b9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.288856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcca3b-5a63-4bda-a342-25fc5a3331e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:16.289690 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcca3b-5a63-4bda-a342-25fc5a3331e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.289995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcca3b-5a63-4bda-a342-25fc5a3331e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.290602 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcca3b-5a63-4bda-a342-25fc5a3331e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.298697 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-dbf8dfbb-be1c-42cf-8f35-95c3aa38b9e0 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:16.299919 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-dbf8dfbb-be1c-42cf-8f35-95c3aa38b9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:16.301259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcca3b-5a63-4bda-a342-25fc5a3331e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.302706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcca3b-5a63-4bda-a342-25fc5a3331e7 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.308629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 810/1617] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:16.310007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4bc56-3a27-49fa-b224-0d23329240cf None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.310360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4bc56-3a27-49fa-b224-0d23329240cf None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.310782 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4bc56-3a27-49fa-b224-0d23329240cf None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.312056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 811/1618] 10.222.0.58 () {54 vars in 961 bytes} [Tue May 17 12:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:06:16.317049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4bc56-3a27-49fa-b224-0d23329240cf None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:16.317378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 808/1619] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:16.318251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcca3b-5a63-4bda-a342-25fc5a3331e7 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:16.328832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcca3b-5a63-4bda-a342-25fc5a3331e7 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:16.334336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4bc56-3a27-49fa-b224-0d23329240cf None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:16.336073 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad94b46-0489-4d87-94b3-0f3f5500cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:16.337146 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94b46-0489-4d87-94b3-0f3f5500cdf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.337483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94b46-0489-4d87-94b3-0f3f5500cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.338215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad94b46-0489-4d87-94b3-0f3f5500cdf5 admin admin] PATH_INFO: `/v3/projects/5302e18979084c3cb9afd8022031cb91/users/97646fca9e63421a9a61abab74c5088e/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.340456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b516c9d-ce85-44b3-8eb0-757da44d71a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:16.341546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b516c9d-ce85-44b3-8eb0-757da44d71a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.343700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b516c9d-ce85-44b3-8eb0-757da44d71a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.344362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b516c9d-ce85-44b3-8eb0-757da44d71a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.356868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad94b46-0489-4d87-94b3-0f3f5500cdf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5302e18979084c3cb9afd8022031cb91, user_id=97646fca9e63421a9a61abab74c5088e, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.360229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad94b46-0489-4d87-94b3-0f3f5500cdf5 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.360436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b516c9d-ce85-44b3-8eb0-757da44d71a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.362025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b516c9d-ce85-44b3-8eb0-757da44d71a0 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.377008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 812/1620] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:16.378657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c63b08-e91d-420b-b859-502d65421af3 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.379069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c63b08-e91d-420b-b859-502d65421af3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.379450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c63b08-e91d-420b-b859-502d65421af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.381548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 809/1621] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:16 2022] PUT /identity/v3/projects/5302e18979084c3cb9afd8022031cb91/users/97646fca9e63421a9a61abab74c5088e/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:16.382927 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad94b46-0489-4d87-94b3-0f3f5500cdf5 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:16.408100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e8c63b08-e91d-420b-b859-502d65421af3 None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:16.409621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e8c63b08-e91d-420b-b859-502d65421af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:16.457470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad94b46-0489-4d87-94b3-0f3f5500cdf5 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:16.463734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3ba2b-0d24-4c5a-85af-3415df24c7da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:16.466012 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3ba2b-0d24-4c5a-85af-3415df24c7da service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.466369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3ba2b-0d24-4c5a-85af-3415df24c7da service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.466570 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3ba2b-0d24-4c5a-85af-3415df24c7da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.541045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 813/1622] 10.222.0.58 () {58 vars in 1058 bytes} [Tue May 17 12:06:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:16.542111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c63b08-e91d-420b-b859-502d65421af3 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:16.572806 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3ba2b-0d24-4c5a-85af-3415df24c7da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.574487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3ba2b-0d24-4c5a-85af-3415df24c7da service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.591821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 810/1623] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:16.593069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3ba2b-0d24-4c5a-85af-3415df24c7da service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:16.612798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3ba2b-0d24-4c5a-85af-3415df24c7da service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:16.623266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a87f9-cc37-4b97-99c5-13855e12c204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:16.624075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a87f9-cc37-4b97-99c5-13855e12c204 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.624642 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a87f9-cc37-4b97-99c5-13855e12c204 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.624993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a87f9-cc37-4b97-99c5-13855e12c204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.634959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c63b08-e91d-420b-b859-502d65421af3 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:16.642493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d4b23-755a-4260-8f82-85b1761010b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:16.643374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d4b23-755a-4260-8f82-85b1761010b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.643693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d4b23-755a-4260-8f82-85b1761010b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.644025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d4b23-755a-4260-8f82-85b1761010b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.645199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d4b23-755a-4260-8f82-85b1761010b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.647038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d4b23-755a-4260-8f82-85b1761010b1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.661694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 814/1624] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:16.667452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d4b23-755a-4260-8f82-85b1761010b1 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:16.679034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d4b23-755a-4260-8f82-85b1761010b1 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:16.685535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3386b72-b209-45c8-8e96-17fb6a77e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:16.687083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386b72-b209-45c8-8e96-17fb6a77e8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.687370 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386b72-b209-45c8-8e96-17fb6a77e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.688147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3386b72-b209-45c8-8e96-17fb6a77e8cd admin admin] PATH_INFO: `/v3/projects/5302e18979084c3cb9afd8022031cb91/users/97646fca9e63421a9a61abab74c5088e/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.690667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3386b72-b209-45c8-8e96-17fb6a77e8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5302e18979084c3cb9afd8022031cb91, user_id=97646fca9e63421a9a61abab74c5088e, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.694950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3386b72-b209-45c8-8e96-17fb6a77e8cd admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.708084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a87f9-cc37-4b97-99c5-13855e12c204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:16.720022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a87f9-cc37-4b97-99c5-13855e12c204 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:16.721179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 815/1625] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:16 2022] PUT /identity/v3/projects/5302e18979084c3cb9afd8022031cb91/users/97646fca9e63421a9a61abab74c5088e/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:16.722933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 811/1626] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:16.723945 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364611d7-15ff-4e26-9531-55b1d9f7121b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:16.724632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364611d7-15ff-4e26-9531-55b1d9f7121b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:16.724924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364611d7-15ff-4e26-9531-55b1d9f7121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:16.758104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-364611d7-15ff-4e26-9531-55b1d9f7121b None None] MFA Rules not processed for user `97646fca9e63421a9a61abab74c5088e`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:16.760780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-364611d7-15ff-4e26-9531-55b1d9f7121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:16.947603 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 816/1627] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:16.958964 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a87f9-cc37-4b97-99c5-13855e12c204 service nova] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:17.030410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4178-e7ec-4201-b0fa-418ba083070d None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:17.031325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4178-e7ec-4201-b0fa-418ba083070d None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:17.031759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4178-e7ec-4201-b0fa-418ba083070d None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:17.033707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 817/1628] 10.222.0.58 () {54 vars in 912 bytes} [Tue May 17 12:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:06:17.041079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3942a-6dd3-4c86-aac9-598d926548b8 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:17.041857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3942a-6dd3-4c86-aac9-598d926548b8 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:17.041857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3942a-6dd3-4c86-aac9-598d926548b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:17.070428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-81c3942a-6dd3-4c86-aac9-598d926548b8 None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:17.071965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a87f9-cc37-4b97-99c5-13855e12c204 service nova] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:17.072113 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-81c3942a-6dd3-4c86-aac9-598d926548b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:17.167218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc355f5-4dd4-4b10-9423-8e21e1a7026f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:17.169143 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc355f5-4dd4-4b10-9423-8e21e1a7026f service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:17.169557 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc355f5-4dd4-4b10-9423-8e21e1a7026f service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:17.170243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc355f5-4dd4-4b10-9423-8e21e1a7026f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:17.194546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc355f5-4dd4-4b10-9423-8e21e1a7026f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:17.196829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc355f5-4dd4-4b10-9423-8e21e1a7026f service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:17.209596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 812/1629] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:17.224651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 818/1630] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:06:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 17 12:06:17.242951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc355f5-4dd4-4b10-9423-8e21e1a7026f service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:17.259752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc355f5-4dd4-4b10-9423-8e21e1a7026f service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:17.274948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac768ca-d1fd-4217-81dc-222303f8dabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:17.277549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac768ca-d1fd-4217-81dc-222303f8dabc service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:17.278358 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac768ca-d1fd-4217-81dc-222303f8dabc service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:17.279301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac768ca-d1fd-4217-81dc-222303f8dabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:17.309018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac768ca-d1fd-4217-81dc-222303f8dabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:17.311144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac768ca-d1fd-4217-81dc-222303f8dabc service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:17.321787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3942a-6dd3-4c86-aac9-598d926548b8 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:17.336654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3942a-6dd3-4c86-aac9-598d926548b8 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:17.342537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 813/1631] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:17.357907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75ff53-10f6-493c-abc6-c774a08dbb08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:17.358818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75ff53-10f6-493c-abc6-c774a08dbb08 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:17.359106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75ff53-10f6-493c-abc6-c774a08dbb08 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:17.359628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75ff53-10f6-493c-abc6-c774a08dbb08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:17.529527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75ff53-10f6-493c-abc6-c774a08dbb08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:17.534373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75ff53-10f6-493c-abc6-c774a08dbb08 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:17.574385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 819/1632] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:18.458658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422e05-2868-4bc5-a8ea-b1a1f2ce1be4 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:18.459433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422e05-2868-4bc5-a8ea-b1a1f2ce1be4 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:18.459519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422e05-2868-4bc5-a8ea-b1a1f2ce1be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:18.519952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-6e422e05-2868-4bc5-a8ea-b1a1f2ce1be4 None None] MFA Rules not processed for user `2c48fb9b327045ed9236bea1ef6cdd73`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:18.521262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6e422e05-2868-4bc5-a8ea-b1a1f2ce1be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:18.673677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 814/1633] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:18.690177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518174d-9055-4ee3-a6d1-ee5726e3bd57 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:18.690666 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518174d-9055-4ee3-a6d1-ee5726e3bd57 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:18.690825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518174d-9055-4ee3-a6d1-ee5726e3bd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:18.728579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-8518174d-9055-4ee3-a6d1-ee5726e3bd57 None None] MFA Rules not processed for user `2c48fb9b327045ed9236bea1ef6cdd73`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:18.730338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-8518174d-9055-4ee3-a6d1-ee5726e3bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:18.750998 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 820/1634] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:18.766788 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e422e05-2868-4bc5-a8ea-b1a1f2ce1be4 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:18.789923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e422e05-2868-4bc5-a8ea-b1a1f2ce1be4 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:18.807833 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e476c72-2181-4d07-b0e1-5b8e3eae0367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:18.809351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476c72-2181-4d07-b0e1-5b8e3eae0367 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:18.810213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476c72-2181-4d07-b0e1-5b8e3eae0367 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:18.810554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e476c72-2181-4d07-b0e1-5b8e3eae0367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:18.832740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e476c72-2181-4d07-b0e1-5b8e3eae0367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:18.836098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e476c72-2181-4d07-b0e1-5b8e3eae0367 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:18.866710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 815/1635] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:18.961418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2280-638d-40c0-934d-45b38a2b6e88 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:18.961979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2280-638d-40c0-934d-45b38a2b6e88 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:18.962601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2280-638d-40c0-934d-45b38a2b6e88 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:18.964542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 821/1636] 10.222.0.58 () {54 vars in 961 bytes} [Tue May 17 12:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:06:18.971678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437381f-4e0c-4429-9d33-09589b5727a1 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:18.972272 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437381f-4e0c-4429-9d33-09589b5727a1 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:18.972742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437381f-4e0c-4429-9d33-09589b5727a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:19.014923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f437381f-4e0c-4429-9d33-09589b5727a1 None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:19.016369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f437381f-4e0c-4429-9d33-09589b5727a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:19.027229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 816/1637] 10.222.0.58 () {58 vars in 1058 bytes} [Tue May 17 12:06:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:06:19.033156 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c70c73-08ad-4207-83ca-59c42524b0f2 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:19.033535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c70c73-08ad-4207-83ca-59c42524b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:19.033883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c70c73-08ad-4207-83ca-59c42524b0f2 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:19.035617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 822/1638] 10.222.0.58 () {54 vars in 912 bytes} [Tue May 17 12:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:06:19.041849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a27d3-5bf7-409a-b793-4dbefc876501 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:19.042224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a27d3-5bf7-409a-b793-4dbefc876501 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:19.042565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a27d3-5bf7-409a-b793-4dbefc876501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:19.068313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-693a27d3-5bf7-409a-b793-4dbefc876501 None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:19.070135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-693a27d3-5bf7-409a-b793-4dbefc876501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:19.097824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 817/1639] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:06:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:19.099929 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c70c73-08ad-4207-83ca-59c42524b0f2 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:19.112669 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c70c73-08ad-4207-83ca-59c42524b0f2 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:19.116860 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ddd7f-7af8-4c2a-b7f7-a1b9e41003dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:19.117203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ddd7f-7af8-4c2a-b7f7-a1b9e41003dd service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:19.117558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ddd7f-7af8-4c2a-b7f7-a1b9e41003dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:19.119168 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ddd7f-7af8-4c2a-b7f7-a1b9e41003dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:19.131380 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ddd7f-7af8-4c2a-b7f7-a1b9e41003dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:19.133022 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ddd7f-7af8-4c2a-b7f7-a1b9e41003dd service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:19.146256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 823/1640] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:06:19.334166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1312d-8b87-4a0e-9fad-1461e1bef5d4 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:19.334989 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1312d-8b87-4a0e-9fad-1461e1bef5d4 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:19.335348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1312d-8b87-4a0e-9fad-1461e1bef5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:19.410985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-36f1312d-8b87-4a0e-9fad-1461e1bef5d4 None None] MFA Rules not processed for user `afa1d6f88acf47dda13d4fd7ea891fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:19.413183 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-36f1312d-8b87-4a0e-9fad-1461e1bef5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:19.582741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ddd7f-7af8-4c2a-b7f7-a1b9e41003dd service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:19.585360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 818/1641] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:19.588499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69462cbf-3b3d-480f-8f79-2927ccaa756d None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:19.588790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69462cbf-3b3d-480f-8f79-2927ccaa756d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:19.589069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69462cbf-3b3d-480f-8f79-2927ccaa756d None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:19.590803 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 819/1642] 10.222.0.58 () {54 vars in 912 bytes} [Tue May 17 12:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:06:19.598706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c9d5-7e6d-4085-bb09-8511569eea8a None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:19.598991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c9d5-7e6d-4085-bb09-8511569eea8a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:19.599267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559c9d5-7e6d-4085-bb09-8511569eea8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:19.650162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2559c9d5-7e6d-4085-bb09-8511569eea8a None None] MFA Rules not processed for user `95029e6140de425e86b5f9d7e2923bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:19.651458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2559c9d5-7e6d-4085-bb09-8511569eea8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:19.691067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ddd7f-7af8-4c2a-b7f7-a1b9e41003dd service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:19.700586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea9e13-820f-4b11-858a-e69713cf0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:19.701340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea9e13-820f-4b11-858a-e69713cf0cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:19.701678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea9e13-820f-4b11-858a-e69713cf0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:19.702295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea9e13-820f-4b11-858a-e69713cf0cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:19.702759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea9e13-820f-4b11-858a-e69713cf0cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:19.705442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea9e13-820f-4b11-858a-e69713cf0cb9 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:19.736732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 820/1643] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:06:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:19.752335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c9d5-7e6d-4085-bb09-8511569eea8a None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:19.760786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 824/1644] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:19 2022] POST /identity/v3/projects => generated 403 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:19.762080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea9e13-820f-4b11-858a-e69713cf0cb9 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:19.767239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559c9d5-7e6d-4085-bb09-8511569eea8a None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:19.876789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea9e13-820f-4b11-858a-e69713cf0cb9 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:19.892800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4983f-816c-472a-82de-125e1d01e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:19.895181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4983f-816c-472a-82de-125e1d01e9ac admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:19.895610 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4983f-816c-472a-82de-125e1d01e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:19.895894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4983f-816c-472a-82de-125e1d01e9ac admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:19.897739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4983f-816c-472a-82de-125e1d01e9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:19.906987 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4983f-816c-472a-82de-125e1d01e9ac admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:19.967544 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 825/1645] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:19 2022] POST /identity/v3/users => generated 308 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:19.971618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4983f-816c-472a-82de-125e1d01e9ac admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:19.975129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e87810-9078-45c5-b34a-cf31c1712dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:19.977182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e87810-9078-45c5-b34a-cf31c1712dee service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:19.978367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e87810-9078-45c5-b34a-cf31c1712dee service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:19.978859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e87810-9078-45c5-b34a-cf31c1712dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:19.989320 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4983f-816c-472a-82de-125e1d01e9ac admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:20.000150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65739a-709d-4091-abc6-2452217ce0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:20.000957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65739a-709d-4091-abc6-2452217ce0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:20.002091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65739a-709d-4091-abc6-2452217ce0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:20.002375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65739a-709d-4091-abc6-2452217ce0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:20.003375 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e87810-9078-45c5-b34a-cf31c1712dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:20.005025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65739a-709d-4091-abc6-2452217ce0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:20.005166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e87810-9078-45c5-b34a-cf31c1712dee service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:20.006685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65739a-709d-4091-abc6-2452217ce0e2 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:20.016680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 821/1646] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:06:20.032890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e87810-9078-45c5-b34a-cf31c1712dee service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:20.036777 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 826/1647] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:06:20.047690 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e87810-9078-45c5-b34a-cf31c1712dee service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:20.059180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc472de8-c02b-448d-8fbe-82dae2935091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:20.060219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc472de8-c02b-448d-8fbe-82dae2935091 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:20.060641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc472de8-c02b-448d-8fbe-82dae2935091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:20.060930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc472de8-c02b-448d-8fbe-82dae2935091 admin admin] PATH_INFO: `/v3/projects/7c0f7b4d1fd1413e8ffde84c9a59ac55/users/06dfb7541f0a4e1fbfb099c62ecf5e80/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:20.096844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc472de8-c02b-448d-8fbe-82dae2935091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0f7b4d1fd1413e8ffde84c9a59ac55, user_id=06dfb7541f0a4e1fbfb099c62ecf5e80, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:20.102251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc472de8-c02b-448d-8fbe-82dae2935091 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:20.123452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 822/1648] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:20 2022] PUT /identity/v3/projects/7c0f7b4d1fd1413e8ffde84c9a59ac55/users/06dfb7541f0a4e1fbfb099c62ecf5e80/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:20.128526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65739a-709d-4091-abc6-2452217ce0e2 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:20.146670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65739a-709d-4091-abc6-2452217ce0e2 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:20.249987 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656febe-73bc-4c50-9efb-3797cab954cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:20.252569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656febe-73bc-4c50-9efb-3797cab954cf admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:20.252569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656febe-73bc-4c50-9efb-3797cab954cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:20.252806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656febe-73bc-4c50-9efb-3797cab954cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:20.256212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656febe-73bc-4c50-9efb-3797cab954cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:20.258131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656febe-73bc-4c50-9efb-3797cab954cf admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:20.283605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 827/1649] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:06:20.285341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc472de8-c02b-448d-8fbe-82dae2935091 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:20.315059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc472de8-c02b-448d-8fbe-82dae2935091 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:20.337550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea9f95-c552-4399-9057-d239fda58d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:20.338929 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea9f95-c552-4399-9057-d239fda58d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:20.341128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea9f95-c552-4399-9057-d239fda58d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:20.343771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea9f95-c552-4399-9057-d239fda58d83 admin admin] PATH_INFO: `/v3/projects/7c0f7b4d1fd1413e8ffde84c9a59ac55/users/06dfb7541f0a4e1fbfb099c62ecf5e80/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:20.351711 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea9f95-c552-4399-9057-d239fda58d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0f7b4d1fd1413e8ffde84c9a59ac55, user_id=06dfb7541f0a4e1fbfb099c62ecf5e80, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:20.355532 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea9f95-c552-4399-9057-d239fda58d83 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:20.386042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 823/1650] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:20 2022] PUT /identity/v3/projects/7c0f7b4d1fd1413e8ffde84c9a59ac55/users/06dfb7541f0a4e1fbfb099c62ecf5e80/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:06:21.182183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985855f-7337-46f7-88be-708b78a44d0b None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:21.182722 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985855f-7337-46f7-88be-708b78a44d0b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:21.182722 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985855f-7337-46f7-88be-708b78a44d0b None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:21.184125 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 828/1651] 10.222.0.58 () {54 vars in 960 bytes} [Tue May 17 12:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:06:21.191868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b533-49c4-41da-81cd-8c2af09e402f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:21.192493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b533-49c4-41da-81cd-8c2af09e402f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:21.192892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b533-49c4-41da-81cd-8c2af09e402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:21.226349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-6d84b533-49c4-41da-81cd-8c2af09e402f None None] MFA Rules not processed for user `c5222a62941948229324ec8c073caf86`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:21.233240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6d84b533-49c4-41da-81cd-8c2af09e402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:21.363263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 824/1652] 10.222.0.58 () {58 vars in 1057 bytes} [Tue May 17 12:06:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:21.371853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985855f-7337-46f7-88be-708b78a44d0b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:21.396619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985855f-7337-46f7-88be-708b78a44d0b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:21.402550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b7361-6ac8-4830-9c6e-6420c3ddb4e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5222a62941948229324ec8c073caf86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:21.403210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7361-6ac8-4830-9c6e-6420c3ddb4e1 service placement] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:21.403493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7361-6ac8-4830-9c6e-6420c3ddb4e1 service placement] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:21.403769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b7361-6ac8-4830-9c6e-6420c3ddb4e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:21.405657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-7a8b7361-6ac8-4830-9c6e-6420c3ddb4e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:21.420840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b7361-6ac8-4830-9c6e-6420c3ddb4e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:21.423604 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b7361-6ac8-4830-9c6e-6420c3ddb4e1 service placement] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:21.439027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 829/1653] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:23.028475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84b533-49c4-41da-81cd-8c2af09e402f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:23.156042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84b533-49c4-41da-81cd-8c2af09e402f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:23.172423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a5219-3eae-4e27-9aa8-d305a74d6e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:23.175569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a5219-3eae-4e27-9aa8-d305a74d6e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:23.176104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a5219-3eae-4e27-9aa8-d305a74d6e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:23.189554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a5219-3eae-4e27-9aa8-d305a74d6e05 admin admin] PATH_INFO: `/v3/users/2b1f12a32d3b478b999a91d242fed3c2` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:23.191392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a5219-3eae-4e27-9aa8-d305a74d6e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1f12a32d3b478b999a91d242fed3c2)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:23.193867 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a5219-3eae-4e27-9aa8-d305a74d6e05 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:23.326259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2a2a5219-3eae-4e27-9aa8-d305a74d6e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1f12a32d3b478b999a91d242fed3c2'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:23.327172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2a2a5219-3eae-4e27-9aa8-d305a74d6e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1f12a32d3b478b999a91d242fed3c2'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:23.338108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2a2a5219-3eae-4e27-9aa8-d305a74d6e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1f12a32d3b478b999a91d242fed3c2'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:23.355172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2a2a5219-3eae-4e27-9aa8-d305a74d6e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1f12a32d3b478b999a91d242fed3c2'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:23.356135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2a2a5219-3eae-4e27-9aa8-d305a74d6e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1f12a32d3b478b999a91d242fed3c2'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:23.407442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 825/1654] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:23 2022] DELETE /identity/v3/users/2b1f12a32d3b478b999a91d242fed3c2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:23.410348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26e90-04ce-4558-a260-70e5e706736a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:23.411163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26e90-04ce-4558-a260-70e5e706736a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:23.412215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26e90-04ce-4558-a260-70e5e706736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:23.499956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-2eb26e90-04ce-4558-a260-70e5e706736a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:23.505572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2eb26e90-04ce-4558-a260-70e5e706736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:23.738852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 830/1655] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:06:23.745330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70acd4-bf34-4d91-ad0d-4e01e24721a6 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:23.745647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70acd4-bf34-4d91-ad0d-4e01e24721a6 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:23.745928 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70acd4-bf34-4d91-ad0d-4e01e24721a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:23.767425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb26e90-04ce-4558-a260-70e5e706736a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:23.769014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2eb26e90-04ce-4558-a260-70e5e706736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:23.831199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ee70acd4-bf34-4d91-ad0d-4e01e24721a6 None None] MFA Rules not processed for user `06dfb7541f0a4e1fbfb099c62ecf5e80`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:23.832500 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ee70acd4-bf34-4d91-ad0d-4e01e24721a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:23.927857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb26e90-04ce-4558-a260-70e5e706736a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:23.935573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4f96-ec96-4345-ad67-765109c3aec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:23.936862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4f96-ec96-4345-ad67-765109c3aec9 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:23.937147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4f96-ec96-4345-ad67-765109c3aec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:23.937440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4f96-ec96-4345-ad67-765109c3aec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:23.968170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b4f96-ec96-4345-ad67-765109c3aec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:23.970055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b4f96-ec96-4345-ad67-765109c3aec9 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:23.976434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 826/1656] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:23 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:23.989663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 831/1657] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:26.202108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70acd4-bf34-4d91-ad0d-4e01e24721a6 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:26.205507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ee70acd4-bf34-4d91-ad0d-4e01e24721a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:26.232618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70acd4-bf34-4d91-ad0d-4e01e24721a6 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:26.247774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:26.250134 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:26.251913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:26.254111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] PATH_INFO: `/v3/projects/21dae19410e148c5b90ea66f5d658452` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:26.262803 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] RBAC: Authorizing `identity:delete_project(project_id=21dae19410e148c5b90ea66f5d658452)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:26.263885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: WARNING py.warnings [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 12:06:26.263885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: warnings.warn(msg) May 17 12:06:26.263885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: May 17 12:06:26.267469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:26.425183 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21dae19410e148c5b90ea66f5d658452', 'request_id': 'req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:26.469716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21dae19410e148c5b90ea66f5d658452', 'request_id': 'req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:26.489667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21dae19410e148c5b90ea66f5d658452', 'request_id': 'req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:26.537995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] The token cache is being invalidate because project 21dae19410e148c5b90ea66f5d658452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:26.545382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:26.549208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-626f0d97-dee7-4d3d-a7dc-43b4666aa13e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:26.557695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 827/1658] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:26 2022] DELETE /identity/v3/projects/21dae19410e148c5b90ea66f5d658452 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:26.561557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4f96-ec96-4345-ad67-765109c3aec9 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:26.577780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4f96-ec96-4345-ad67-765109c3aec9 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:26.729526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:26.730487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:26.730968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:26.731258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] PATH_INFO: `/v3/users/97646fca9e63421a9a61abab74c5088e` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:26.733022 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97646fca9e63421a9a61abab74c5088e)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:26.734080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: WARNING py.warnings [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 12:06:26.734080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: warnings.warn(msg) May 17 12:06:26.734080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: May 17 12:06:26.735405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:26.920723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97646fca9e63421a9a61abab74c5088e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:26.943925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97646fca9e63421a9a61abab74c5088e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:26.961574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97646fca9e63421a9a61abab74c5088e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:26.962261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97646fca9e63421a9a61abab74c5088e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:26.962959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97646fca9e63421a9a61abab74c5088e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:27.021949 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 832/1659] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:26 2022] DELETE /identity/v3/users/97646fca9e63421a9a61abab74c5088e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:28.243671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cf286-844c-41bd-99f7-2aa55090a1a3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:28.244731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cf286-844c-41bd-99f7-2aa55090a1a3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:28.245159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cf286-844c-41bd-99f7-2aa55090a1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:28.286680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-395cf286-844c-41bd-99f7-2aa55090a1a3 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:28.288245 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-395cf286-844c-41bd-99f7-2aa55090a1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:28.429131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 828/1660] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:06:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:28.671340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:28.674409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:28.719997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cf286-844c-41bd-99f7-2aa55090a1a3 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:28.721652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-395cf286-844c-41bd-99f7-2aa55090a1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:28.869314 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cf286-844c-41bd-99f7-2aa55090a1a3 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:28.878910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7c816-1635-4c50-9636-58c892738443 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:28.879788 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7c816-1635-4c50-9636-58c892738443 service swift] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:28.880484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7c816-1635-4c50-9636-58c892738443 service swift] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:28.880961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7c816-1635-4c50-9636-58c892738443 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:28.884523 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee57897-49ae-4b24-8ff0-ff35ecec95c5 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:28.924469 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:28.925543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:28.925649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:28.925882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] PATH_INFO: `/v3/projects/5302e18979084c3cb9afd8022031cb91` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:28.927783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5302e18979084c3cb9afd8022031cb91)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:28.940157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7c816-1635-4c50-9636-58c892738443 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:28.941852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7c816-1635-4c50-9636-58c892738443 service swift] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:28.955943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:28.977227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 829/1661] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:06:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 12:06:28.981554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a26729-7856-4342-88fa-72cf326746d7 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:28.982175 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a26729-7856-4342-88fa-72cf326746d7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:28.984498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a26729-7856-4342-88fa-72cf326746d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:29.113909 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-53a26729-7856-4342-88fa-72cf326746d7 None None] MFA Rules not processed for user `e8a6a76a94ca4fb197c7b1705b809c54`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:29.119618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-53a26729-7856-4342-88fa-72cf326746d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:29.381598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 830/1662] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:29.388729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a26729-7856-4342-88fa-72cf326746d7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:29.393173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-53a26729-7856-4342-88fa-72cf326746d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:29.645759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a26729-7856-4342-88fa-72cf326746d7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:29.663328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c9018-a23a-42f2-9efc-ca409b821f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:29.664204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c9018-a23a-42f2-9efc-ca409b821f71 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:29.664994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c9018-a23a-42f2-9efc-ca409b821f71 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:29.667410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c9018-a23a-42f2-9efc-ca409b821f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:29.687566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c9018-a23a-42f2-9efc-ca409b821f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:29.692521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c9018-a23a-42f2-9efc-ca409b821f71 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:29.698150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5302e18979084c3cb9afd8022031cb91', 'request_id': 'req-e15e10b7-a083-4d12-a984-9c066b7e7766'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:29.720579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5302e18979084c3cb9afd8022031cb91', 'request_id': 'req-e15e10b7-a083-4d12-a984-9c066b7e7766'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:29.722206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 831/1663] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:29.734799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5302e18979084c3cb9afd8022031cb91', 'request_id': 'req-e15e10b7-a083-4d12-a984-9c066b7e7766'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:29.763430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] The token cache is being invalidate because project 5302e18979084c3cb9afd8022031cb91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:29.764896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:29.766477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e15e10b7-a083-4d12-a984-9c066b7e7766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:29.772003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 833/1664] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:28 2022] DELETE /identity/v3/projects/5302e18979084c3cb9afd8022031cb91 => generated 0 bytes in 1101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:29.778727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0d1d-7959-4a72-a53d-48857e963be8 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:29.779224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0d1d-7959-4a72-a53d-48857e963be8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:29.779757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e0d1d-7959-4a72-a53d-48857e963be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:29.817289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-256e0d1d-7959-4a72-a53d-48857e963be8 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:29.819143 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-256e0d1d-7959-4a72-a53d-48857e963be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:29.975721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 832/1665] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:29.986378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4296539-3cd4-4b0b-be9f-acfb77644933 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:29.987613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4296539-3cd4-4b0b-be9f-acfb77644933 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:29.990228 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4296539-3cd4-4b0b-be9f-acfb77644933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:30.091784 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e4296539-3cd4-4b0b-be9f-acfb77644933 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:30.093318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e4296539-3cd4-4b0b-be9f-acfb77644933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:30.133188 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 834/1666] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:30.142178 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e0d1d-7959-4a72-a53d-48857e963be8 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:30.160910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e0d1d-7959-4a72-a53d-48857e963be8 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:30.190765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18afe9-45e2-4cf0-95cb-46133222bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:30.195554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18afe9-45e2-4cf0-95cb-46133222bf0c admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:30.196832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18afe9-45e2-4cf0-95cb-46133222bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:30.198233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18afe9-45e2-4cf0-95cb-46133222bf0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:30.199951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18afe9-45e2-4cf0-95cb-46133222bf0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:30.201823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18afe9-45e2-4cf0-95cb-46133222bf0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:30.213417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18afe9-45e2-4cf0-95cb-46133222bf0c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:30.257845 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 833/1667] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:30.262870 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4296539-3cd4-4b0b-be9f-acfb77644933 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:30.282941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4296539-3cd4-4b0b-be9f-acfb77644933 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:30.309122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a96265-dde9-4577-be77-f15aaa8e851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:30.310267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a96265-dde9-4577-be77-f15aaa8e851a admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:30.330790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a96265-dde9-4577-be77-f15aaa8e851a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:30.332101 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a96265-dde9-4577-be77-f15aaa8e851a admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:30.342742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a96265-dde9-4577-be77-f15aaa8e851a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:30.363604 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a96265-dde9-4577-be77-f15aaa8e851a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:30.488829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 835/1668] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:30 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:06:30.493553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18afe9-45e2-4cf0-95cb-46133222bf0c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:30.529692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18afe9-45e2-4cf0-95cb-46133222bf0c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:30.628925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a96265-dde9-4577-be77-f15aaa8e851a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:30.631440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f0a96265-dde9-4577-be77-f15aaa8e851a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:30.800322 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4fcd4-ac85-46d4-9eaf-ff0f074d8be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:30.803293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4fcd4-ac85-46d4-9eaf-ff0f074d8be9 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:30.803293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4fcd4-ac85-46d4-9eaf-ff0f074d8be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:30.803293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4fcd4-ac85-46d4-9eaf-ff0f074d8be9 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:30.803293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4fcd4-ac85-46d4-9eaf-ff0f074d8be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:30.807591 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4fcd4-ac85-46d4-9eaf-ff0f074d8be9 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:30.889892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 834/1669] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:30 2022] POST /identity/v3/users => generated 293 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:30.894926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4fcd4-ac85-46d4-9eaf-ff0f074d8be9 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:30.910457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a96265-dde9-4577-be77-f15aaa8e851a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:30.922643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4fcd4-ac85-46d4-9eaf-ff0f074d8be9 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:30.934697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9d71e-2f69-4429-a014-2902b0bba3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:30.936162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d71e-2f69-4429-a014-2902b0bba3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:30.936162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d71e-2f69-4429-a014-2902b0bba3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:30.936162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d71e-2f69-4429-a014-2902b0bba3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:30.936615 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9d71e-2f69-4429-a014-2902b0bba3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:30.938260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9d71e-2f69-4429-a014-2902b0bba3e1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:30.938765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50706b71-9aa6-4699-bde4-defee30a5109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:30.940374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706b71-9aa6-4699-bde4-defee30a5109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:30.940911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706b71-9aa6-4699-bde4-defee30a5109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:30.941321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50706b71-9aa6-4699-bde4-defee30a5109 admin admin] PATH_INFO: `/v3/users/ca5437b5c23049a9b9d116f84665c9e2` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:30.945881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50706b71-9aa6-4699-bde4-defee30a5109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5437b5c23049a9b9d116f84665c9e2)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:30.958087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50706b71-9aa6-4699-bde4-defee30a5109 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:30.970646 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 835/1670] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:30.974920 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9d71e-2f69-4429-a014-2902b0bba3e1 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:30.999770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9d71e-2f69-4429-a014-2902b0bba3e1 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:31.018959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfdbf0-f939-49b8-9a6a-935f67a70e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:31.019440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfdbf0-f939-49b8-9a6a-935f67a70e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:31.019872 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfdbf0-f939-49b8-9a6a-935f67a70e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:31.020319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfdbf0-f939-49b8-9a6a-935f67a70e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:31.021475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfdbf0-f939-49b8-9a6a-935f67a70e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:31.024169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfdbf0-f939-49b8-9a6a-935f67a70e29 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:31.059604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 836/1671] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:06:31.065035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfdbf0-f939-49b8-9a6a-935f67a70e29 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:31.105448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfdbf0-f939-49b8-9a6a-935f67a70e29 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:31.122190 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5005545-70ae-479d-a9d1-72b829be2c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:31.122548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5005545-70ae-479d-a9d1-72b829be2c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:31.122723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5005545-70ae-479d-a9d1-72b829be2c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:31.123005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5005545-70ae-479d-a9d1-72b829be2c94 admin admin] PATH_INFO: `/v3/projects/5672226d78fe4439b27cf16e96bf713f/users/b8c07ce1d0814225b9640058c3163330/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:31.161971 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5005545-70ae-479d-a9d1-72b829be2c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5672226d78fe4439b27cf16e96bf713f, user_id=b8c07ce1d0814225b9640058c3163330, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:31.165646 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5005545-70ae-479d-a9d1-72b829be2c94 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:31.199818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-50706b71-9aa6-4699-bde4-defee30a5109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5437b5c23049a9b9d116f84665c9e2'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:31.214123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 837/1672] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:31 2022] PUT /identity/v3/projects/5672226d78fe4439b27cf16e96bf713f/users/b8c07ce1d0814225b9640058c3163330/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:06:31.226402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ae84b-402c-49e0-ac09-d74e1570a735 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:31.226693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ae84b-402c-49e0-ac09-d74e1570a735 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:31.226979 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ae84b-402c-49e0-ac09-d74e1570a735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:31.238159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-50706b71-9aa6-4699-bde4-defee30a5109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5437b5c23049a9b9d116f84665c9e2'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:31.257863 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-50706b71-9aa6-4699-bde4-defee30a5109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5437b5c23049a9b9d116f84665c9e2'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:31.265121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-50706b71-9aa6-4699-bde4-defee30a5109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5437b5c23049a9b9d116f84665c9e2'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:31.268095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-50706b71-9aa6-4699-bde4-defee30a5109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5437b5c23049a9b9d116f84665c9e2'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:31.319148 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-003ae84b-402c-49e0-ac09-d74e1570a735 None None] MFA Rules not processed for user `b8c07ce1d0814225b9640058c3163330`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:31.323792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-003ae84b-402c-49e0-ac09-d74e1570a735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:31.358983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 836/1673] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:30 2022] DELETE /identity/v3/users/ca5437b5c23049a9b9d116f84665c9e2 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:06:31.363971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129c24-4a0f-4e48-b3f2-f1ed53f6f175 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:31.364284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129c24-4a0f-4e48-b3f2-f1ed53f6f175 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:31.364566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129c24-4a0f-4e48-b3f2-f1ed53f6f175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:31.430983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a8129c24-4a0f-4e48-b3f2-f1ed53f6f175 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:31.433505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a8129c24-4a0f-4e48-b3f2-f1ed53f6f175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:31.514512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 838/1674] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:06:31.519958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ae84b-402c-49e0-ac09-d74e1570a735 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:31.525464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-003ae84b-402c-49e0-ac09-d74e1570a735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:31.656706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ae84b-402c-49e0-ac09-d74e1570a735 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:31.687977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 837/1675] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:31.768219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8129c24-4a0f-4e48-b3f2-f1ed53f6f175 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:31.770013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a8129c24-4a0f-4e48-b3f2-f1ed53f6f175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:31.780169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d0bef-707d-48f7-8822-3d675418c1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:31.780879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0bef-707d-48f7-8822-3d675418c1ff admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:31.781166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0bef-707d-48f7-8822-3d675418c1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:31.781450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d0bef-707d-48f7-8822-3d675418c1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:31.782155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d0bef-707d-48f7-8822-3d675418c1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:31.784074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d0bef-707d-48f7-8822-3d675418c1ff admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:31.847321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 839/1676] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:31 2022] POST /identity/v3/projects => generated 387 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:31.851376 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d0bef-707d-48f7-8822-3d675418c1ff admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:31.960367 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8129c24-4a0f-4e48-b3f2-f1ed53f6f175 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:32.033147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d0bef-707d-48f7-8822-3d675418c1ff admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:32.050225 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb8d1a-41f2-4bf7-a926-183dd45ccf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:32.050927 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb8d1a-41f2-4bf7-a926-183dd45ccf44 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:32.051213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb8d1a-41f2-4bf7-a926-183dd45ccf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:32.051489 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb8d1a-41f2-4bf7-a926-183dd45ccf44 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:32.052217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb8d1a-41f2-4bf7-a926-183dd45ccf44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:32.054792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb8d1a-41f2-4bf7-a926-183dd45ccf44 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:32.126270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 840/1677] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:31 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:06:32.128753 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb8d1a-41f2-4bf7-a926-183dd45ccf44 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:32.166121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb8d1a-41f2-4bf7-a926-183dd45ccf44 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:32.186995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d8755-d3c6-44bd-9b28-49d57a273ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:32.189779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d8755-d3c6-44bd-9b28-49d57a273ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:32.190070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d8755-d3c6-44bd-9b28-49d57a273ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:32.190351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d8755-d3c6-44bd-9b28-49d57a273ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:32.191100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d8755-d3c6-44bd-9b28-49d57a273ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:32.199982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c00620-0f52-44a1-8ea7-7cfad5840084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:32.200708 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00620-0f52-44a1-8ea7-7cfad5840084 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:32.201000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00620-0f52-44a1-8ea7-7cfad5840084 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:32.201339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00620-0f52-44a1-8ea7-7cfad5840084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:32.201769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d8755-d3c6-44bd-9b28-49d57a273ce2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:32.241003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c00620-0f52-44a1-8ea7-7cfad5840084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:32.242461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c00620-0f52-44a1-8ea7-7cfad5840084 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:32.246331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 841/1678] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:32.248807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d8755-d3c6-44bd-9b28-49d57a273ce2 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:32.272577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 838/1679] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:06:32.313925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d8755-d3c6-44bd-9b28-49d57a273ce2 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:32.341512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c558a0-f480-4983-b135-4faa40ee1408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:32.343521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c558a0-f480-4983-b135-4faa40ee1408 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:32.344075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c558a0-f480-4983-b135-4faa40ee1408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:32.344585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c558a0-f480-4983-b135-4faa40ee1408 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:32.345567 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c558a0-f480-4983-b135-4faa40ee1408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:32.362065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c558a0-f480-4983-b135-4faa40ee1408 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:32.407456 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 842/1680] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:32.411922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c00620-0f52-44a1-8ea7-7cfad5840084 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:32.447210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c00620-0f52-44a1-8ea7-7cfad5840084 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:32.465104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863530e-3a0e-4ef8-9123-5d842678c208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:32.466066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863530e-3a0e-4ef8-9123-5d842678c208 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:32.466353 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863530e-3a0e-4ef8-9123-5d842678c208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:32.466696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863530e-3a0e-4ef8-9123-5d842678c208 admin admin] PATH_INFO: `/v3/projects/cda6be2525c64e87922fa48c92fe7522/users/0b130a6ed3c04e0f9514a7ca38e28119/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:32.481303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c558a0-f480-4983-b135-4faa40ee1408 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:32.483113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-81c558a0-f480-4983-b135-4faa40ee1408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:32.510539 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c558a0-f480-4983-b135-4faa40ee1408 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:32.540385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16a653-9088-4b56-beba-5d61275891f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:32.543682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863530e-3a0e-4ef8-9123-5d842678c208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda6be2525c64e87922fa48c92fe7522, user_id=0b130a6ed3c04e0f9514a7ca38e28119, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:32.545166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a653-9088-4b56-beba-5d61275891f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:32.545547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a653-9088-4b56-beba-5d61275891f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:32.545904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16a653-9088-4b56-beba-5d61275891f5 admin admin] PATH_INFO: `/v3/users/afa1d6f88acf47dda13d4fd7ea891fc8` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:32.550416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863530e-3a0e-4ef8-9123-5d842678c208 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:32.551300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16a653-9088-4b56-beba-5d61275891f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa1d6f88acf47dda13d4fd7ea891fc8)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:32.553397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16a653-9088-4b56-beba-5d61275891f5 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:32.595732 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 839/1681] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:32 2022] PUT /identity/v3/projects/cda6be2525c64e87922fa48c92fe7522/users/0b130a6ed3c04e0f9514a7ca38e28119/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:32.597188 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df228717-9c02-4864-b2d6-54cb8b57c570 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:32.598564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df228717-9c02-4864-b2d6-54cb8b57c570 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:32.598920 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df228717-9c02-4864-b2d6-54cb8b57c570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:32.681268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ca16a653-9088-4b56-beba-5d61275891f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa1d6f88acf47dda13d4fd7ea891fc8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:32.691360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ca16a653-9088-4b56-beba-5d61275891f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa1d6f88acf47dda13d4fd7ea891fc8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:32.710062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-df228717-9c02-4864-b2d6-54cb8b57c570 None None] MFA Rules not processed for user `79ff688720854ad1b62b3c9b51546e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:32.710603 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ca16a653-9088-4b56-beba-5d61275891f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa1d6f88acf47dda13d4fd7ea891fc8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:32.714043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-df228717-9c02-4864-b2d6-54cb8b57c570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:32.744663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ca16a653-9088-4b56-beba-5d61275891f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa1d6f88acf47dda13d4fd7ea891fc8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:32.745993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ca16a653-9088-4b56-beba-5d61275891f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa1d6f88acf47dda13d4fd7ea891fc8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:32.824509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 843/1682] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:32 2022] DELETE /identity/v3/users/afa1d6f88acf47dda13d4fd7ea891fc8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:06:32.826219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24537-9bf2-414a-9d5f-2c5237592c6e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:32.826690 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24537-9bf2-414a-9d5f-2c5237592c6e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:32.827201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24537-9bf2-414a-9d5f-2c5237592c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:32.952121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-25e24537-9bf2-414a-9d5f-2c5237592c6e None None] MFA Rules not processed for user `0b130a6ed3c04e0f9514a7ca38e28119`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:32.957455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-25e24537-9bf2-414a-9d5f-2c5237592c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:33.061867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 840/1683] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:33.063484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df228717-9c02-4864-b2d6-54cb8b57c570 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:33.067752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-df228717-9c02-4864-b2d6-54cb8b57c570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:33.201952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 844/1684] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:33.205495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e24537-9bf2-414a-9d5f-2c5237592c6e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:33.208251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-25e24537-9bf2-414a-9d5f-2c5237592c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:33.371496 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df228717-9c02-4864-b2d6-54cb8b57c570 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:33.455421 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e24537-9bf2-414a-9d5f-2c5237592c6e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:33.471493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211d530-2ec7-4d53-84ba-c56deee793db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:33.472558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211d530-2ec7-4d53-84ba-c56deee793db admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:33.473049 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211d530-2ec7-4d53-84ba-c56deee793db admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:33.475107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211d530-2ec7-4d53-84ba-c56deee793db admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:33.476030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211d530-2ec7-4d53-84ba-c56deee793db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:33.478573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211d530-2ec7-4d53-84ba-c56deee793db admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:33.508013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc716-9263-49c0-b5b3-8735ac9331b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:33.511156 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc716-9263-49c0-b5b3-8735ac9331b9 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:33.511989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc716-9263-49c0-b5b3-8735ac9331b9 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:33.518589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc716-9263-49c0-b5b3-8735ac9331b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:33.587366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 845/1685] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:33 2022] POST /identity/v3/projects => generated 387 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:33.589244 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211d530-2ec7-4d53-84ba-c56deee793db admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:33.815975 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211d530-2ec7-4d53-84ba-c56deee793db admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:33.832366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cc716-9263-49c0-b5b3-8735ac9331b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:33.835253 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad77682-61f3-4176-835c-35fed78c41ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:33.835947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cc716-9263-49c0-b5b3-8735ac9331b9 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:33.836061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad77682-61f3-4176-835c-35fed78c41ec admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:33.836316 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad77682-61f3-4176-835c-35fed78c41ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:33.838585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad77682-61f3-4176-835c-35fed78c41ec admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:33.839410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad77682-61f3-4176-835c-35fed78c41ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:33.843762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad77682-61f3-4176-835c-35fed78c41ec admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:33.870780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 841/1686] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:33.950242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 846/1687] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:33 2022] POST /identity/v3/users => generated 300 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:33.950857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc716-9263-49c0-b5b3-8735ac9331b9 service nova] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:33.970066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc716-9263-49c0-b5b3-8735ac9331b9 service nova] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:34.001117 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ac30-df26-4e5b-843c-a83dd138695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:34.003494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ac30-df26-4e5b-843c-a83dd138695a admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:34.005058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ac30-df26-4e5b-843c-a83dd138695a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:34.005576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ac30-df26-4e5b-843c-a83dd138695a admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:34.010004 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49ac30-df26-4e5b-843c-a83dd138695a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:34.017867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49ac30-df26-4e5b-843c-a83dd138695a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:34.066507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 842/1688] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:34.070527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad77682-61f3-4176-835c-35fed78c41ec admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:34.102913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad77682-61f3-4176-835c-35fed78c41ec admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:34.126145 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c7b91-8e9c-4208-9d54-ebc4e2f63867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:34.131162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c7b91-8e9c-4208-9d54-ebc4e2f63867 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:34.131484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c7b91-8e9c-4208-9d54-ebc4e2f63867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:34.131775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c7b91-8e9c-4208-9d54-ebc4e2f63867 admin admin] PATH_INFO: `/v3/projects/c6aafb0c1ff841e3bae62c7084212ad5/users/ba35b3af8d12470682765bb42f957a6a/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:34.225107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c7b91-8e9c-4208-9d54-ebc4e2f63867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6aafb0c1ff841e3bae62c7084212ad5, user_id=ba35b3af8d12470682765bb42f957a6a, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:34.239732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c7b91-8e9c-4208-9d54-ebc4e2f63867 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:34.296203 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 847/1689] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:34 2022] PUT /identity/v3/projects/c6aafb0c1ff841e3bae62c7084212ad5/users/ba35b3af8d12470682765bb42f957a6a/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:34.300431 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ac30-df26-4e5b-843c-a83dd138695a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:34.350530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ac30-df26-4e5b-843c-a83dd138695a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:34.619895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6e871-8239-4601-814d-be9f376ff379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:34.620777 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e871-8239-4601-814d-be9f376ff379 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:34.621060 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e871-8239-4601-814d-be9f376ff379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:34.621336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e871-8239-4601-814d-be9f376ff379 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:34.622075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6e871-8239-4601-814d-be9f376ff379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:34.623681 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6e871-8239-4601-814d-be9f376ff379 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:34.645458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 843/1690] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:34.647761 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c7b91-8e9c-4208-9d54-ebc4e2f63867 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:34.706833 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c7b91-8e9c-4208-9d54-ebc4e2f63867 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:34.719459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea246d3-a715-4f61-8e8f-55cac7e83e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:34.725239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea246d3-a715-4f61-8e8f-55cac7e83e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:34.727831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea246d3-a715-4f61-8e8f-55cac7e83e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:34.728458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea246d3-a715-4f61-8e8f-55cac7e83e09 admin admin] PATH_INFO: `/v3/projects/c6aafb0c1ff841e3bae62c7084212ad5/users/ba35b3af8d12470682765bb42f957a6a/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:34.734881 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea246d3-a715-4f61-8e8f-55cac7e83e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6aafb0c1ff841e3bae62c7084212ad5, user_id=ba35b3af8d12470682765bb42f957a6a, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:34.765377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea246d3-a715-4f61-8e8f-55cac7e83e09 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:34.815826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 848/1691] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:34 2022] PUT /identity/v3/projects/c6aafb0c1ff841e3bae62c7084212ad5/users/ba35b3af8d12470682765bb42f957a6a/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:34.818602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b291cd3-c798-466a-ac21-ba97e8dca80e None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:34.819497 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b291cd3-c798-466a-ac21-ba97e8dca80e None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:34.819966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b291cd3-c798-466a-ac21-ba97e8dca80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:34.886215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58da70-eb97-49ea-9223-94b66af1b226 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:34.886518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58da70-eb97-49ea-9223-94b66af1b226 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:34.886841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58da70-eb97-49ea-9223-94b66af1b226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:34.941827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4b291cd3-c798-466a-ac21-ba97e8dca80e None None] MFA Rules not processed for user `ba35b3af8d12470682765bb42f957a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:34.947401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4b291cd3-c798-466a-ac21-ba97e8dca80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:34.976669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-bb58da70-eb97-49ea-9223-94b66af1b226 None None] MFA Rules not processed for user `95029e6140de425e86b5f9d7e2923bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:34.980112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bb58da70-eb97-49ea-9223-94b66af1b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:35.147438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 849/1692] 10.222.0.35 () {58 vars in 1015 bytes} [Tue May 17 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:35.151389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58da70-eb97-49ea-9223-94b66af1b226 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:35.162531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bb58da70-eb97-49ea-9223-94b66af1b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:35.233313 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 844/1693] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:35.234582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b291cd3-c798-466a-ac21-ba97e8dca80e None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:35.236009 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4b291cd3-c798-466a-ac21-ba97e8dca80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:35.269977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b291cd3-c798-466a-ac21-ba97e8dca80e None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:35.278500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef742-4832-4346-b518-484d37b429b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:35.279174 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef742-4832-4346-b518-484d37b429b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:35.279454 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef742-4832-4346-b518-484d37b429b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:35.279729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ef742-4832-4346-b518-484d37b429b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:35.291242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ef742-4832-4346-b518-484d37b429b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:35.293090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ef742-4832-4346-b518-484d37b429b8 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:35.313072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 845/1694] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:35.313072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef742-4832-4346-b518-484d37b429b8 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:35.318527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-743ef742-4832-4346-b518-484d37b429b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:35.347494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58da70-eb97-49ea-9223-94b66af1b226 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:35.365592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:35.366488 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:35.366770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:35.367093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] PATH_INFO: `/v3/projects/e7418bc2e2fd419a9bd526f8c443d044` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:35.371663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7418bc2e2fd419a9bd526f8c443d044)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:35.375292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:35.484400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ef742-4832-4346-b518-484d37b429b8 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:35.498717 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe373937-3735-48d4-8a8f-aa4f90e8b4b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:35.499397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe373937-3735-48d4-8a8f-aa4f90e8b4b7 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:35.499682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe373937-3735-48d4-8a8f-aa4f90e8b4b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:35.501929 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe373937-3735-48d4-8a8f-aa4f90e8b4b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:35.556173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7418bc2e2fd419a9bd526f8c443d044', 'request_id': 'req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:35.563309 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe373937-3735-48d4-8a8f-aa4f90e8b4b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:35.564746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe373937-3735-48d4-8a8f-aa4f90e8b4b7 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:35.574288 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7418bc2e2fd419a9bd526f8c443d044', 'request_id': 'req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:35.593256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7418bc2e2fd419a9bd526f8c443d044', 'request_id': 'req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:35.598371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 846/1695] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:35.652734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] The token cache is being invalidate because project e7418bc2e2fd419a9bd526f8c443d044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:35.658672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:35.660530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:35.671270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 850/1696] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:35 2022] DELETE /identity/v3/projects/e7418bc2e2fd419a9bd526f8c443d044 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:35.672630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe373937-3735-48d4-8a8f-aa4f90e8b4b7 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:35.702007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe373937-3735-48d4-8a8f-aa4f90e8b4b7 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:35.937541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:35.938446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:35.938731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:35.939024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] PATH_INFO: `/v3/users/06dfb7541f0a4e1fbfb099c62ecf5e80` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:35.946833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06dfb7541f0a4e1fbfb099c62ecf5e80)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:35.948935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:36.132753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06dfb7541f0a4e1fbfb099c62ecf5e80'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:36.156251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06dfb7541f0a4e1fbfb099c62ecf5e80'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:36.173387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06dfb7541f0a4e1fbfb099c62ecf5e80'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:36.174378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06dfb7541f0a4e1fbfb099c62ecf5e80'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:36.175319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06dfb7541f0a4e1fbfb099c62ecf5e80'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:36.228722 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 847/1697] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:35 2022] DELETE /identity/v3/users/06dfb7541f0a4e1fbfb099c62ecf5e80 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:36.796728 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:36.798973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:36.887041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7caa51-dd5b-49d1-a555-e61f1279dc9f admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:36.963140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4619ff-3699-4cff-93e5-d3146dd160a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:36.964951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4619ff-3699-4cff-93e5-d3146dd160a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:36.966320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4619ff-3699-4cff-93e5-d3146dd160a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:36.966966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4619ff-3699-4cff-93e5-d3146dd160a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:36.969228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7e4619ff-3699-4cff-93e5-d3146dd160a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:37.059599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4619ff-3699-4cff-93e5-d3146dd160a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:37.061621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4619ff-3699-4cff-93e5-d3146dd160a0 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:37.097344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 851/1698] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:37.753138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:37.754733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:37.923817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af654c-c6d2-4fe4-bb00-3130b74a726f admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:37.937355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:37.938347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:37.938536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:37.938820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] PATH_INFO: `/v3/projects/b24cd1a360fe4f798dc75cdcdc79ab4b` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:37.940678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24cd1a360fe4f798dc75cdcdc79ab4b)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:37.942826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:38.098792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24cd1a360fe4f798dc75cdcdc79ab4b', 'request_id': 'req-626aa6ac-7e84-4fd0-bce8-ace793e8f841'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:38.116383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24cd1a360fe4f798dc75cdcdc79ab4b', 'request_id': 'req-626aa6ac-7e84-4fd0-bce8-ace793e8f841'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:38.150824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24cd1a360fe4f798dc75cdcdc79ab4b', 'request_id': 'req-626aa6ac-7e84-4fd0-bce8-ace793e8f841'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:38.176094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] The token cache is being invalidate because project b24cd1a360fe4f798dc75cdcdc79ab4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:38.176642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:38.178048 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-626aa6ac-7e84-4fd0-bce8-ace793e8f841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:38.188650 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 848/1699] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:37 2022] DELETE /identity/v3/projects/b24cd1a360fe4f798dc75cdcdc79ab4b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:38.193658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21244e02-4019-4ca6-be59-b7ac586e2d11 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:38.201620 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21244e02-4019-4ca6-be59-b7ac586e2d11 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:38.201919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21244e02-4019-4ca6-be59-b7ac586e2d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:38.263308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-21244e02-4019-4ca6-be59-b7ac586e2d11 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:38.264512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-21244e02-4019-4ca6-be59-b7ac586e2d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:38.447747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 852/1700] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:38.457035 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5498415-db72-4dc7-9626-c6153ff8b5bc None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:38.457244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5498415-db72-4dc7-9626-c6153ff8b5bc None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:38.457489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5498415-db72-4dc7-9626-c6153ff8b5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:38.551841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-c5498415-db72-4dc7-9626-c6153ff8b5bc None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:38.557615 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c5498415-db72-4dc7-9626-c6153ff8b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:38.587160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 849/1701] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:38.590711 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21244e02-4019-4ca6-be59-b7ac586e2d11 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:38.606194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21244e02-4019-4ca6-be59-b7ac586e2d11 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:38.620342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3937c-94dc-423d-b917-7c19a1d1bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:38.621151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3937c-94dc-423d-b917-7c19a1d1bb08 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:38.621384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3937c-94dc-423d-b917-7c19a1d1bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:38.621668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3937c-94dc-423d-b917-7c19a1d1bb08 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:38.625999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3937c-94dc-423d-b917-7c19a1d1bb08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:38.628283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3937c-94dc-423d-b917-7c19a1d1bb08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:38.630377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3937c-94dc-423d-b917-7c19a1d1bb08 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:38.670359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 853/1702] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:38.675840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5498415-db72-4dc7-9626-c6153ff8b5bc None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:38.692267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5498415-db72-4dc7-9626-c6153ff8b5bc None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:38.716388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf13b5-c1ff-4b47-bab8-f77ce5095af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:38.717158 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf13b5-c1ff-4b47-bab8-f77ce5095af2 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:38.718504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf13b5-c1ff-4b47-bab8-f77ce5095af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:38.718806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf13b5-c1ff-4b47-bab8-f77ce5095af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:38.721679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf13b5-c1ff-4b47-bab8-f77ce5095af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:38.732086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf13b5-c1ff-4b47-bab8-f77ce5095af2 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:38.809609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cae2c6-6e56-4ec7-8cbf-166409215ce1 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:38.810268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cae2c6-6e56-4ec7-8cbf-166409215ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:38.811131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cae2c6-6e56-4ec7-8cbf-166409215ce1 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:38.813398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 854/1703] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 12:06:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:06:38.918341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 850/1704] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:38 2022] POST /identity/v3/projects => generated 365 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:38.922868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cae2c6-6e56-4ec7-8cbf-166409215ce1 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:38.952255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c3625-480e-4792-b29c-071f56546085 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:38.952491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c3625-480e-4792-b29c-071f56546085 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:38.952773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c3625-480e-4792-b29c-071f56546085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:39.047399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-9d7c3625-480e-4792-b29c-071f56546085 None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:39.049937 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9d7c3625-480e-4792-b29c-071f56546085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:39.177682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cae2c6-6e56-4ec7-8cbf-166409215ce1 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:39.217665 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9df7ed-8123-42f5-8e5c-6adbd61254ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:39.218344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9df7ed-8123-42f5-8e5c-6adbd61254ec admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:39.218635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9df7ed-8123-42f5-8e5c-6adbd61254ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:39.219016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9df7ed-8123-42f5-8e5c-6adbd61254ec admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:39.219745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9df7ed-8123-42f5-8e5c-6adbd61254ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:39.228914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9df7ed-8123-42f5-8e5c-6adbd61254ec admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:39.292918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 855/1705] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:38 2022] POST /identity/v3/users => generated 283 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:06:39.298829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9df7ed-8123-42f5-8e5c-6adbd61254ec admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:39.307233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 851/1706] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 12:06:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:06:39.328380 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9df7ed-8123-42f5-8e5c-6adbd61254ec admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:39.345751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3165e0-c648-4847-8a12-bdc2276ea278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:39.346459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3165e0-c648-4847-8a12-bdc2276ea278 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:39.346835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3165e0-c648-4847-8a12-bdc2276ea278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:39.347337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3165e0-c648-4847-8a12-bdc2276ea278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:39.348536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3165e0-c648-4847-8a12-bdc2276ea278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:39.350346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3165e0-c648-4847-8a12-bdc2276ea278 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:39.386339 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 856/1707] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:39.395614 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c3625-480e-4792-b29c-071f56546085 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:39.415769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3165e0-c648-4847-8a12-bdc2276ea278 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:39.419692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9d3165e0-c648-4847-8a12-bdc2276ea278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:39.436236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c3625-480e-4792-b29c-071f56546085 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:39.453565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd10ec5-4ef5-4563-91c3-0abe4d936a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:39.458169 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd10ec5-4ef5-4563-91c3-0abe4d936a70 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:39.458414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd10ec5-4ef5-4563-91c3-0abe4d936a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:39.459707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd10ec5-4ef5-4563-91c3-0abe4d936a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:39.461195 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd10ec5-4ef5-4563-91c3-0abe4d936a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:39.463838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd10ec5-4ef5-4563-91c3-0abe4d936a70 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:39.464460 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3165e0-c648-4847-8a12-bdc2276ea278 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:39.478707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:39.486797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:39.487471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:39.487901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] PATH_INFO: `/v3/projects/7c0f7b4d1fd1413e8ffde84c9a59ac55` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:39.493473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0f7b4d1fd1413e8ffde84c9a59ac55)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:39.495791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:39.502750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 852/1708] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:39.511184 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd10ec5-4ef5-4563-91c3-0abe4d936a70 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:39.529235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd10ec5-4ef5-4563-91c3-0abe4d936a70 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:39.535341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019f79a-2898-4d75-a2dd-49fc4943fea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:39.536383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019f79a-2898-4d75-a2dd-49fc4943fea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:39.536701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019f79a-2898-4d75-a2dd-49fc4943fea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:39.537031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019f79a-2898-4d75-a2dd-49fc4943fea9 admin admin] PATH_INFO: `/v3/projects/c3e418bb8453416e9ee996a822f2d771/users/03f4e586f0394c2480653404617d1fa8/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:39.563762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019f79a-2898-4d75-a2dd-49fc4943fea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e418bb8453416e9ee996a822f2d771, user_id=03f4e586f0394c2480653404617d1fa8, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:39.575095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019f79a-2898-4d75-a2dd-49fc4943fea9 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:39.600067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0f7b4d1fd1413e8ffde84c9a59ac55', 'request_id': 'req-8e06deaf-277e-4f73-aff5-db23967d07b8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:39.611100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 853/1709] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:39 2022] PUT /identity/v3/projects/c3e418bb8453416e9ee996a822f2d771/users/03f4e586f0394c2480653404617d1fa8/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:39.623433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c131e99-8e08-4775-ae7e-1d2e7ca57fc0 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:39.624109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c131e99-8e08-4775-ae7e-1d2e7ca57fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:39.624396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c131e99-8e08-4775-ae7e-1d2e7ca57fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:39.627503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0f7b4d1fd1413e8ffde84c9a59ac55', 'request_id': 'req-8e06deaf-277e-4f73-aff5-db23967d07b8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:39.639281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0f7b4d1fd1413e8ffde84c9a59ac55', 'request_id': 'req-8e06deaf-277e-4f73-aff5-db23967d07b8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:39.683950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] The token cache is being invalidate because project 7c0f7b4d1fd1413e8ffde84c9a59ac55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:39.684943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:39.685885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8e06deaf-277e-4f73-aff5-db23967d07b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:39.689662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 857/1710] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:39 2022] DELETE /identity/v3/projects/7c0f7b4d1fd1413e8ffde84c9a59ac55 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:39.695154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708f8e-5d9b-4513-8013-f3c39100d8a5 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:39.695929 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708f8e-5d9b-4513-8013-f3c39100d8a5 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:39.696445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa708f8e-5d9b-4513-8013-f3c39100d8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:39.749250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-aa708f8e-5d9b-4513-8013-f3c39100d8a5 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:39.751216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-aa708f8e-5d9b-4513-8013-f3c39100d8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:39.761156 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-3c131e99-8e08-4775-ae7e-1d2e7ca57fc0 None None] MFA Rules not processed for user `03f4e586f0394c2480653404617d1fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:39.765418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-3c131e99-8e08-4775-ae7e-1d2e7ca57fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:39.923720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 858/1711] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:39.926066 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa708f8e-5d9b-4513-8013-f3c39100d8a5 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:39.934844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-aa708f8e-5d9b-4513-8013-f3c39100d8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:39.997727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 854/1712] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:39.997727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e83c63-f39e-4aed-98d5-2edb950028cd None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:39.997727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e83c63-f39e-4aed-98d5-2edb950028cd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:39.997727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e83c63-f39e-4aed-98d5-2edb950028cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:40.043790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-76e83c63-f39e-4aed-98d5-2edb950028cd None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:40.049632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-76e83c63-f39e-4aed-98d5-2edb950028cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:40.085105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 855/1713] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:40.087935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e83c63-f39e-4aed-98d5-2edb950028cd None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:40.095695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-76e83c63-f39e-4aed-98d5-2edb950028cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:40.155376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e83c63-f39e-4aed-98d5-2edb950028cd None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:40.169003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646d19a-56b8-4000-ab8b-33eb6ad332d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:40.169842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646d19a-56b8-4000-ab8b-33eb6ad332d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:40.170181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646d19a-56b8-4000-ab8b-33eb6ad332d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:40.170518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646d19a-56b8-4000-ab8b-33eb6ad332d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:40.171319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646d19a-56b8-4000-ab8b-33eb6ad332d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:40.173339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646d19a-56b8-4000-ab8b-33eb6ad332d4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:40.284053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa708f8e-5d9b-4513-8013-f3c39100d8a5 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:40.292924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 856/1714] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:40 2022] POST /identity/v3/projects => generated 363 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:40.292924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646d19a-56b8-4000-ab8b-33eb6ad332d4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:40.309217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b3816-3221-4bb2-b8be-53758c77751b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:40.309939 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b3816-3221-4bb2-b8be-53758c77751b service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:40.323215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b3816-3221-4bb2-b8be-53758c77751b service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:40.323568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b3816-3221-4bb2-b8be-53758c77751b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:40.328952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0d4b3816-3221-4bb2-b8be-53758c77751b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:40.396250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b3816-3221-4bb2-b8be-53758c77751b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:40.397876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b3816-3221-4bb2-b8be-53758c77751b service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:40.439461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 859/1715] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:40.447494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b3816-3221-4bb2-b8be-53758c77751b service nova] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:40.468826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646d19a-56b8-4000-ab8b-33eb6ad332d4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:40.485765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b3816-3221-4bb2-b8be-53758c77751b service nova] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:40.498019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fbab4-81e4-4ff0-a5f4-5803bd533dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:40.513273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fbab4-81e4-4ff0-a5f4-5803bd533dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:40.513273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fbab4-81e4-4ff0-a5f4-5803bd533dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:40.513578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fbab4-81e4-4ff0-a5f4-5803bd533dbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:40.514392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fbab4-81e4-4ff0-a5f4-5803bd533dbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:40.514758 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fbab4-81e4-4ff0-a5f4-5803bd533dbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:40.516592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fbab4-81e4-4ff0-a5f4-5803bd533dbf admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:40.525566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4885994-cb6d-4251-84df-90c7dbe36d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:40.526286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4885994-cb6d-4251-84df-90c7dbe36d2f admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:40.526580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4885994-cb6d-4251-84df-90c7dbe36d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:40.526860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4885994-cb6d-4251-84df-90c7dbe36d2f admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:40.535782 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4885994-cb6d-4251-84df-90c7dbe36d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:40.539289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4885994-cb6d-4251-84df-90c7dbe36d2f admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:40.604581 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 857/1716] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:40.609778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fbab4-81e4-4ff0-a5f4-5803bd533dbf admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:40.635487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 860/1717] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:40 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:40.649599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4885994-cb6d-4251-84df-90c7dbe36d2f admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:40.654968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fbab4-81e4-4ff0-a5f4-5803bd533dbf admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:40.672845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ec27-fe7b-4ff3-8ce7-8a54987a009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:40.673702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ec27-fe7b-4ff3-8ce7-8a54987a009a admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:40.674132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ec27-fe7b-4ff3-8ce7-8a54987a009a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:40.674518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973ec27-fe7b-4ff3-8ce7-8a54987a009a admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:40.675323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973ec27-fe7b-4ff3-8ce7-8a54987a009a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:40.678672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973ec27-fe7b-4ff3-8ce7-8a54987a009a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:40.707482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4885994-cb6d-4251-84df-90c7dbe36d2f admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:40.728966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db185f-0da2-4381-83e4-a49fee2a78c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:40.730918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db185f-0da2-4381-83e4-a49fee2a78c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:40.731218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db185f-0da2-4381-83e4-a49fee2a78c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:40.731505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db185f-0da2-4381-83e4-a49fee2a78c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:40.732296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db185f-0da2-4381-83e4-a49fee2a78c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:40.739200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db185f-0da2-4381-83e4-a49fee2a78c1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:40.782585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 861/1718] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:40.787256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db185f-0da2-4381-83e4-a49fee2a78c1 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:40.819369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 858/1719] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:40 2022] POST /identity/v3/projects => generated 387 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:06:40.820350 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ec27-fe7b-4ff3-8ce7-8a54987a009a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:40.831149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db185f-0da2-4381-83e4-a49fee2a78c1 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:41.031597 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed92f1-77c0-4105-b126-111871be9529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:41.032647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed92f1-77c0-4105-b126-111871be9529 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:41.032922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed92f1-77c0-4105-b126-111871be9529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:41.033276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed92f1-77c0-4105-b126-111871be9529 admin admin] PATH_INFO: `/v3/projects/e7b7dcecab5d481c8f8d690f1ad5a3a0/users/cb747a6405d9433fabd75ae0325a51e1/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:41.066138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973ec27-fe7b-4ff3-8ce7-8a54987a009a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:41.070151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed92f1-77c0-4105-b126-111871be9529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b7dcecab5d481c8f8d690f1ad5a3a0, user_id=cb747a6405d9433fabd75ae0325a51e1, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:41.074574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed92f1-77c0-4105-b126-111871be9529 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:41.094926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641d977-ee0f-4f7e-bfb1-f00c865d887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:41.095747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641d977-ee0f-4f7e-bfb1-f00c865d887f admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:41.099108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641d977-ee0f-4f7e-bfb1-f00c865d887f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:41.099294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641d977-ee0f-4f7e-bfb1-f00c865d887f admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:41.103240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641d977-ee0f-4f7e-bfb1-f00c865d887f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:41.111202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 862/1720] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:40 2022] PUT /identity/v3/projects/e7b7dcecab5d481c8f8d690f1ad5a3a0/users/cb747a6405d9433fabd75ae0325a51e1/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:41.112598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed92f1-77c0-4105-b126-111871be9529 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:41.113051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641d977-ee0f-4f7e-bfb1-f00c865d887f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:41.190635 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 859/1721] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:40 2022] POST /identity/v3/users => generated 294 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:41.198400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641d977-ee0f-4f7e-bfb1-f00c865d887f admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:41.232082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641d977-ee0f-4f7e-bfb1-f00c865d887f admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:41.304462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed92f1-77c0-4105-b126-111871be9529 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:41.339085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6b7e8-483b-49bb-92c2-7678c630c871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:41.340543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6b7e8-483b-49bb-92c2-7678c630c871 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:41.340831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6b7e8-483b-49bb-92c2-7678c630c871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:41.345659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6b7e8-483b-49bb-92c2-7678c630c871 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:41.347578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6b7e8-483b-49bb-92c2-7678c630c871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:41.353570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6b7e8-483b-49bb-92c2-7678c630c871 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:41.356007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4895c06-de4a-414e-a6eb-b02465086a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:41.356933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4895c06-de4a-414e-a6eb-b02465086a74 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:41.357427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4895c06-de4a-414e-a6eb-b02465086a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:41.357995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4895c06-de4a-414e-a6eb-b02465086a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:41.358864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4895c06-de4a-414e-a6eb-b02465086a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:41.369197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4895c06-de4a-414e-a6eb-b02465086a74 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:41.402945 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 863/1722] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:06:41.404533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c45bb-c7e7-4829-a209-5ce73f30620c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:41.415283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 860/1723] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:41.416089 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c45bb-c7e7-4829-a209-5ce73f30620c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:41.416643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c45bb-c7e7-4829-a209-5ce73f30620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:41.419039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6b7e8-483b-49bb-92c2-7678c630c871 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:41.485069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6b7e8-483b-49bb-92c2-7678c630c871 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:41.492995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c20c45bb-c7e7-4829-a209-5ce73f30620c None None] MFA Rules not processed for user `bb9da9200f804a4a987f2cdb49f6801d`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:41.494530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c20c45bb-c7e7-4829-a209-5ce73f30620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:41.499614 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9b32d-f538-4afb-a068-d147883a60c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:41.500549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b32d-f538-4afb-a068-d147883a60c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:41.501045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b32d-f538-4afb-a068-d147883a60c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:41.501495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b32d-f538-4afb-a068-d147883a60c2 admin admin] PATH_INFO: `/v3/projects/e7b7dcecab5d481c8f8d690f1ad5a3a0/users/cb747a6405d9433fabd75ae0325a51e1/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:41.510701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9b32d-f538-4afb-a068-d147883a60c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b7dcecab5d481c8f8d690f1ad5a3a0, user_id=cb747a6405d9433fabd75ae0325a51e1, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:41.519207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9b32d-f538-4afb-a068-d147883a60c2 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:41.560813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 861/1724] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:41 2022] PUT /identity/v3/projects/e7b7dcecab5d481c8f8d690f1ad5a3a0/users/cb747a6405d9433fabd75ae0325a51e1/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:41.561914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9b32d-f538-4afb-a068-d147883a60c2 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:41.680941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 864/1725] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:41.682769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6206a8b-cf00-407d-912e-e9d28842cf89 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:41.691491 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6206a8b-cf00-407d-912e-e9d28842cf89 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:41.692088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6206a8b-cf00-407d-912e-e9d28842cf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:41.779431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f6206a8b-cf00-407d-912e-e9d28842cf89 None None] MFA Rules not processed for user `cb747a6405d9433fabd75ae0325a51e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:41.781076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f6206a8b-cf00-407d-912e-e9d28842cf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:41.845110 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9b32d-f538-4afb-a068-d147883a60c2 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:41.863281 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233cf86-8be7-4d76-91f2-6db548fef022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:41.864408 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233cf86-8be7-4d76-91f2-6db548fef022 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:41.864710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233cf86-8be7-4d76-91f2-6db548fef022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:41.864985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233cf86-8be7-4d76-91f2-6db548fef022 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:41.865733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233cf86-8be7-4d76-91f2-6db548fef022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:41.867362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233cf86-8be7-4d76-91f2-6db548fef022 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:41.936842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 862/1726] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:41.951591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b2e6e-673d-41d6-9deb-0fcbb16057b8 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:41.951878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b2e6e-673d-41d6-9deb-0fcbb16057b8 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:41.952352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b2e6e-673d-41d6-9deb-0fcbb16057b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:42.020522 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-818b2e6e-673d-41d6-9deb-0fcbb16057b8 None None] MFA Rules not processed for user `bb9da9200f804a4a987f2cdb49f6801d`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:42.021760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-818b2e6e-673d-41d6-9deb-0fcbb16057b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:42.057932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 865/1727] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:42.061788 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8ab7d-1212-4065-bba4-8f28dd7003d3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:42.065504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8ab7d-1212-4065-bba4-8f28dd7003d3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:42.066151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8ab7d-1212-4065-bba4-8f28dd7003d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:42.110802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-5ba8ab7d-1212-4065-bba4-8f28dd7003d3 None None] MFA Rules not processed for user `e8a6a76a94ca4fb197c7b1705b809c54`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:42.113292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5ba8ab7d-1212-4065-bba4-8f28dd7003d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:42.224741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 863/1728] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:42.224741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b2e6e-673d-41d6-9deb-0fcbb16057b8 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:42.258914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b2e6e-673d-41d6-9deb-0fcbb16057b8 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:42.262626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 866/1729] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:42.266843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8ab7d-1212-4065-bba4-8f28dd7003d3 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:42.270055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5ba8ab7d-1212-4065-bba4-8f28dd7003d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:42.281430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53cc8-2df7-49d7-9af4-bb06999f3dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:42.282582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53cc8-2df7-49d7-9af4-bb06999f3dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:42.282775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53cc8-2df7-49d7-9af4-bb06999f3dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:42.283017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53cc8-2df7-49d7-9af4-bb06999f3dbe admin admin] PATH_INFO: `/v3/projects/da3b6bdcb46d42349041ffed886b1c02/users/31bb9d4f13164dbc9643d64cbbf86cd6/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:42.355797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c53cc8-2df7-49d7-9af4-bb06999f3dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3b6bdcb46d42349041ffed886b1c02, user_id=31bb9d4f13164dbc9643d64cbbf86cd6, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:42.377317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c53cc8-2df7-49d7-9af4-bb06999f3dbe admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:42.485396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 864/1730] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:42 2022] PUT /identity/v3/projects/da3b6bdcb46d42349041ffed886b1c02/users/31bb9d4f13164dbc9643d64cbbf86cd6/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:42.486692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53cc8-2df7-49d7-9af4-bb06999f3dbe admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:42.644621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8ab7d-1212-4065-bba4-8f28dd7003d3 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:42.701530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53cc8-2df7-49d7-9af4-bb06999f3dbe admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:42.714684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544bdf-a377-4db6-b6d7-02c7f13febef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:42.715125 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544bdf-a377-4db6-b6d7-02c7f13febef service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:42.715291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544bdf-a377-4db6-b6d7-02c7f13febef service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:42.715573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544bdf-a377-4db6-b6d7-02c7f13febef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:42.731962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf8bbd-332c-485c-88d2-37e50edf6e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:42.732775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf8bbd-332c-485c-88d2-37e50edf6e24 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:42.733084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf8bbd-332c-485c-88d2-37e50edf6e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:42.733501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf8bbd-332c-485c-88d2-37e50edf6e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:42.851860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf8bbd-332c-485c-88d2-37e50edf6e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:42.856554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf8bbd-332c-485c-88d2-37e50edf6e24 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:42.874789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544bdf-a377-4db6-b6d7-02c7f13febef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:42.878161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544bdf-a377-4db6-b6d7-02c7f13febef service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:42.882605 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 867/1731] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:42.887495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92192dd-d0a7-40ec-881c-96d815a4a35f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:42.889324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92192dd-d0a7-40ec-881c-96d815a4a35f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:42.889619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92192dd-d0a7-40ec-881c-96d815a4a35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:42.946856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 865/1732] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:42.949597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170420e-e857-4fe7-8971-e3a626c600af None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:42.957698 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170420e-e857-4fe7-8971-e3a626c600af None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:42.958200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170420e-e857-4fe7-8971-e3a626c600af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:42.970542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-e92192dd-d0a7-40ec-881c-96d815a4a35f None None] MFA Rules not processed for user `586e15d5d16543e6b70c87fbf9079e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:42.979565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e92192dd-d0a7-40ec-881c-96d815a4a35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:43.053236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a170420e-e857-4fe7-8971-e3a626c600af None None] MFA Rules not processed for user `31bb9d4f13164dbc9643d64cbbf86cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:43.054508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a170420e-e857-4fe7-8971-e3a626c600af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:43.186120 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 866/1733] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:43.186953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170420e-e857-4fe7-8971-e3a626c600af None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:43.230565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170420e-e857-4fe7-8971-e3a626c600af None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:43.243588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 868/1734] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:43.248739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92192dd-d0a7-40ec-881c-96d815a4a35f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:43.249900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69e2e3-9e82-4ff0-9f1f-77a074a1a2a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:43.250575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69e2e3-9e82-4ff0-9f1f-77a074a1a2a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:43.250857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69e2e3-9e82-4ff0-9f1f-77a074a1a2a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:43.251133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69e2e3-9e82-4ff0-9f1f-77a074a1a2a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:43.264621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-3b69e2e3-9e82-4ff0-9f1f-77a074a1a2a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:43.522451 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69e2e3-9e82-4ff0-9f1f-77a074a1a2a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:43.546233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92192dd-d0a7-40ec-881c-96d815a4a35f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:43.549016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69e2e3-9e82-4ff0-9f1f-77a074a1a2a0 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:43.585959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55056e4-f3ce-4246-b603-1d82c509dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:43.586714 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55056e4-f3ce-4246-b603-1d82c509dd3a admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:43.587208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55056e4-f3ce-4246-b603-1d82c509dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:43.587592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55056e4-f3ce-4246-b603-1d82c509dd3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:43.596493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55056e4-f3ce-4246-b603-1d82c509dd3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:43.598652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55056e4-f3ce-4246-b603-1d82c509dd3a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:43.614036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 867/1735] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:43.720332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69e2e3-9e82-4ff0-9f1f-77a074a1a2a0 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:43.726820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 869/1736] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:43 2022] POST /identity/v3/projects => generated 387 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:43.743707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69e2e3-9e82-4ff0-9f1f-77a074a1a2a0 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:43.929343 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cef602-7702-4d19-81f4-14f7bcb46bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:43.932571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cef602-7702-4d19-81f4-14f7bcb46bfb admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:43.932860 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cef602-7702-4d19-81f4-14f7bcb46bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:43.933141 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cef602-7702-4d19-81f4-14f7bcb46bfb admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:43.936381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cef602-7702-4d19-81f4-14f7bcb46bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:43.941151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cef602-7702-4d19-81f4-14f7bcb46bfb admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:43.997076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 868/1737] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:43 2022] POST /identity/v3/users => generated 300 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:06:44.003405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55056e4-f3ce-4246-b603-1d82c509dd3a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:44.018220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55056e4-f3ce-4246-b603-1d82c509dd3a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:44.069513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72fbc1-a454-47e8-a6e2-48863a909829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:44.070205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72fbc1-a454-47e8-a6e2-48863a909829 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:44.070496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72fbc1-a454-47e8-a6e2-48863a909829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:44.071056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72fbc1-a454-47e8-a6e2-48863a909829 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:44.072321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72fbc1-a454-47e8-a6e2-48863a909829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:44.073901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72fbc1-a454-47e8-a6e2-48863a909829 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:44.156399 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 870/1738] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:44.156800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cef602-7702-4d19-81f4-14f7bcb46bfb admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:44.183462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cef602-7702-4d19-81f4-14f7bcb46bfb admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:44.202465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7ebc8-4ff5-42c8-9b02-1ef3dc125f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:44.203632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7ebc8-4ff5-42c8-9b02-1ef3dc125f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:44.204269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7ebc8-4ff5-42c8-9b02-1ef3dc125f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:44.204688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7ebc8-4ff5-42c8-9b02-1ef3dc125f68 admin admin] PATH_INFO: `/v3/projects/91692ecd81344805ac66c04b029e6a05/users/a7215583274143518ecde9091e93ce4a/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:44.246844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7ebc8-4ff5-42c8-9b02-1ef3dc125f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91692ecd81344805ac66c04b029e6a05, user_id=a7215583274143518ecde9091e93ce4a, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:44.253760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7ebc8-4ff5-42c8-9b02-1ef3dc125f68 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:44.287118 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 869/1739] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:44 2022] PUT /identity/v3/projects/91692ecd81344805ac66c04b029e6a05/users/a7215583274143518ecde9091e93ce4a/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:06:44.291745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72fbc1-a454-47e8-a6e2-48863a909829 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:44.302354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72fbc1-a454-47e8-a6e2-48863a909829 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:44.421096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7ebc8-4ff5-42c8-9b02-1ef3dc125f68 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:44.592311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a8956-4577-4eae-88db-77dad2b4caad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:44.609858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a8956-4577-4eae-88db-77dad2b4caad admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:44.610160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a8956-4577-4eae-88db-77dad2b4caad admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:44.610430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a8956-4577-4eae-88db-77dad2b4caad admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:44.611509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a8956-4577-4eae-88db-77dad2b4caad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:44.613300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a8956-4577-4eae-88db-77dad2b4caad admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:44.664643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 871/1740] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:44.665846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a8956-4577-4eae-88db-77dad2b4caad admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:44.676163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7ebc8-4ff5-42c8-9b02-1ef3dc125f68 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:44.690663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a8956-4577-4eae-88db-77dad2b4caad admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:44.699140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669aa5c-52e6-49bd-ad2c-39ec9e00f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:44.700097 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669aa5c-52e6-49bd-ad2c-39ec9e00f168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:44.700615 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669aa5c-52e6-49bd-ad2c-39ec9e00f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:44.700734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669aa5c-52e6-49bd-ad2c-39ec9e00f168 admin admin] PATH_INFO: `/v3/users/03f4e586f0394c2480653404617d1fa8` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:44.709175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669aa5c-52e6-49bd-ad2c-39ec9e00f168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f4e586f0394c2480653404617d1fa8)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:44.711164 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669aa5c-52e6-49bd-ad2c-39ec9e00f168 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:44.722461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa5ca3-a69b-4359-a807-f5bf27903cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:44.723441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa5ca3-a69b-4359-a807-f5bf27903cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:44.723800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa5ca3-a69b-4359-a807-f5bf27903cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:44.724086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa5ca3-a69b-4359-a807-f5bf27903cb1 admin admin] PATH_INFO: `/v3/projects/91692ecd81344805ac66c04b029e6a05/users/a7215583274143518ecde9091e93ce4a/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:44.742312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa5ca3-a69b-4359-a807-f5bf27903cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91692ecd81344805ac66c04b029e6a05, user_id=a7215583274143518ecde9091e93ce4a, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:44.745745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa5ca3-a69b-4359-a807-f5bf27903cb1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:44.821611 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 872/1741] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:44 2022] PUT /identity/v3/projects/91692ecd81344805ac66c04b029e6a05/users/a7215583274143518ecde9091e93ce4a/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:44.839505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad9568-1904-4561-8fa8-cc047c9125f7 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:44.840140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad9568-1904-4561-8fa8-cc047c9125f7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:44.840693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad9568-1904-4561-8fa8-cc047c9125f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:44.894589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e669aa5c-52e6-49bd-ad2c-39ec9e00f168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f4e586f0394c2480653404617d1fa8'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:44.917578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e669aa5c-52e6-49bd-ad2c-39ec9e00f168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f4e586f0394c2480653404617d1fa8'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:44.932904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e669aa5c-52e6-49bd-ad2c-39ec9e00f168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f4e586f0394c2480653404617d1fa8'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:44.934127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e669aa5c-52e6-49bd-ad2c-39ec9e00f168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f4e586f0394c2480653404617d1fa8'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:44.935184 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e669aa5c-52e6-49bd-ad2c-39ec9e00f168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f4e586f0394c2480653404617d1fa8'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:44.944954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-e9ad9568-1904-4561-8fa8-cc047c9125f7 None None] MFA Rules not processed for user `a7215583274143518ecde9091e93ce4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:44.946083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e9ad9568-1904-4561-8fa8-cc047c9125f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:44.998888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 870/1742] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:44 2022] DELETE /identity/v3/users/03f4e586f0394c2480653404617d1fa8 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:45.005369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505bef8-2bff-4aa7-ba52-61956d244750 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:45.005668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505bef8-2bff-4aa7-ba52-61956d244750 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:45.005949 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505bef8-2bff-4aa7-ba52-61956d244750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:45.053427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-8505bef8-2bff-4aa7-ba52-61956d244750 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:45.054664 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-8505bef8-2bff-4aa7-ba52-61956d244750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:45.170835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 873/1743] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:45.184368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad9568-1904-4561-8fa8-cc047c9125f7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:45.186290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e9ad9568-1904-4561-8fa8-cc047c9125f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:45.231291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 871/1744] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:45.239175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505bef8-2bff-4aa7-ba52-61956d244750 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:45.241086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-8505bef8-2bff-4aa7-ba52-61956d244750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:45.343076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad9568-1904-4561-8fa8-cc047c9125f7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:45.389469 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505bef8-2bff-4aa7-ba52-61956d244750 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:45.405259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53367db9-db97-4b20-93c2-63e0f81138e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:45.406207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367db9-db97-4b20-93c2-63e0f81138e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:45.406705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367db9-db97-4b20-93c2-63e0f81138e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:45.407157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367db9-db97-4b20-93c2-63e0f81138e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:45.453292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53367db9-db97-4b20-93c2-63e0f81138e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:45.455116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53367db9-db97-4b20-93c2-63e0f81138e1 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:45.530485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 872/1745] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:06:45.546428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4fd0f-9078-4b60-bf1a-7817d87c28b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:45.547240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4fd0f-9078-4b60-bf1a-7817d87c28b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:45.547547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4fd0f-9078-4b60-bf1a-7817d87c28b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:45.547837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4fd0f-9078-4b60-bf1a-7817d87c28b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:45.653204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dac4b-dcdc-4010-bbd9-3fa01df49dfd None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:45.653505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dac4b-dcdc-4010-bbd9-3fa01df49dfd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:45.653805 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3dac4b-dcdc-4010-bbd9-3fa01df49dfd None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:45.659412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 873/1746] 10.222.0.58 () {54 vars in 912 bytes} [Tue May 17 12:06:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 12:06:45.673587 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1ddd-66c9-4f7c-b22d-1712fd5e9387 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:45.674480 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1ddd-66c9-4f7c-b22d-1712fd5e9387 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:45.674818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d1ddd-66c9-4f7c-b22d-1712fd5e9387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:45.721670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4fd0f-9078-4b60-bf1a-7817d87c28b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:45.723150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4fd0f-9078-4b60-bf1a-7817d87c28b8 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:45.728817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-5a1d1ddd-66c9-4f7c-b22d-1712fd5e9387 None None] MFA Rules not processed for user `95029e6140de425e86b5f9d7e2923bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:45.732363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5a1d1ddd-66c9-4f7c-b22d-1712fd5e9387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:45.750248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 874/1747] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:06:45.751307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 874/1748] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:45.785273 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4fd0f-9078-4b60-bf1a-7817d87c28b8 service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:45.787064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-45f4fd0f-9078-4b60-bf1a-7817d87c28b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:45.812250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4fd0f-9078-4b60-bf1a-7817d87c28b8 service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:45.820467 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ea30c-eb5f-490d-a061-f6fc1554b159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:45.824306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ea30c-eb5f-490d-a061-f6fc1554b159 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:45.825053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ea30c-eb5f-490d-a061-f6fc1554b159 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:45.826560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ea30c-eb5f-490d-a061-f6fc1554b159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:45.846076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ea30c-eb5f-490d-a061-f6fc1554b159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:45.847583 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ea30c-eb5f-490d-a061-f6fc1554b159 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:45.870759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d1ddd-66c9-4f7c-b22d-1712fd5e9387 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:45.872561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5a1d1ddd-66c9-4f7c-b22d-1712fd5e9387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:45.883693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 875/1749] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:45.898186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d1ddd-66c9-4f7c-b22d-1712fd5e9387 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:45.911412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da41273-e819-4014-b095-d826336881f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:45.915602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da41273-e819-4014-b095-d826336881f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:45.917234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da41273-e819-4014-b095-d826336881f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:45.917856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da41273-e819-4014-b095-d826336881f1 admin admin] PATH_INFO: `/v3/users/31bb9d4f13164dbc9643d64cbbf86cd6` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:45.921241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da41273-e819-4014-b095-d826336881f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bb9d4f13164dbc9643d64cbbf86cd6)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:45.927599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da41273-e819-4014-b095-d826336881f1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:45.951339 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ea30c-eb5f-490d-a061-f6fc1554b159 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:45.962084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1e1ea30c-eb5f-490d-a061-f6fc1554b159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:46.150422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7da41273-e819-4014-b095-d826336881f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bb9d4f13164dbc9643d64cbbf86cd6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:46.172290 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7da41273-e819-4014-b095-d826336881f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bb9d4f13164dbc9643d64cbbf86cd6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:46.191802 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7da41273-e819-4014-b095-d826336881f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bb9d4f13164dbc9643d64cbbf86cd6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:46.192779 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7da41273-e819-4014-b095-d826336881f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bb9d4f13164dbc9643d64cbbf86cd6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:46.196310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7da41273-e819-4014-b095-d826336881f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bb9d4f13164dbc9643d64cbbf86cd6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:46.251475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ea30c-eb5f-490d-a061-f6fc1554b159 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:46.271165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 875/1750] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:45 2022] DELETE /identity/v3/users/31bb9d4f13164dbc9643d64cbbf86cd6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:46.274911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e99e3-c3ce-46d9-b63a-572f4b028e1a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:46.274911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e99e3-c3ce-46d9-b63a-572f4b028e1a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:46.274911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e99e3-c3ce-46d9-b63a-572f4b028e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:46.275107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec1124-a215-4cbd-a7cf-f6eca9a869d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:46.276950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec1124-a215-4cbd-a7cf-f6eca9a869d7 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:46.277059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec1124-a215-4cbd-a7cf-f6eca9a869d7 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:46.277294 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec1124-a215-4cbd-a7cf-f6eca9a869d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:46.297477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-90ec1124-a215-4cbd-a7cf-f6eca9a869d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:46.325064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e10e99e3-c3ce-46d9-b63a-572f4b028e1a None None] MFA Rules not processed for user `79ff688720854ad1b62b3c9b51546e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:46.326295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e10e99e3-c3ce-46d9-b63a-572f4b028e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:46.405808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec1124-a215-4cbd-a7cf-f6eca9a869d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:46.407686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec1124-a215-4cbd-a7cf-f6eca9a869d7 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:46.427530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 876/1751] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:06:46.428930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaf5f9-d013-429f-b3d6-44316797e249 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:46.429206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaf5f9-d013-429f-b3d6-44316797e249 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:46.429484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaf5f9-d013-429f-b3d6-44316797e249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:46.451026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 876/1752] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:46.457830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e99e3-c3ce-46d9-b63a-572f4b028e1a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:46.461934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e10e99e3-c3ce-46d9-b63a-572f4b028e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:46.479850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-42aaf5f9-d013-429f-b3d6-44316797e249 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:46.483467 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-42aaf5f9-d013-429f-b3d6-44316797e249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:46.654875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e99e3-c3ce-46d9-b63a-572f4b028e1a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:46.668990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 877/1753] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:46.669389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:46.670478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:46.670851 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:46.671225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] PATH_INFO: `/v3/projects/c3e418bb8453416e9ee996a822f2d771` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:46.673954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaf5f9-d013-429f-b3d6-44316797e249 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:46.675332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-42aaf5f9-d013-429f-b3d6-44316797e249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:46.679378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e418bb8453416e9ee996a822f2d771)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:46.686220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:46.835701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e418bb8453416e9ee996a822f2d771', 'request_id': 'req-6af141db-48c0-4c54-abde-c07458dc18ca'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:46.871391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e418bb8453416e9ee996a822f2d771', 'request_id': 'req-6af141db-48c0-4c54-abde-c07458dc18ca'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:46.879090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaf5f9-d013-429f-b3d6-44316797e249 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:46.885956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e418bb8453416e9ee996a822f2d771', 'request_id': 'req-6af141db-48c0-4c54-abde-c07458dc18ca'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:46.956753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] The token cache is being invalidate because project c3e418bb8453416e9ee996a822f2d771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:46.957337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:46.958324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6af141db-48c0-4c54-abde-c07458dc18ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:46.962499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 877/1754] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:46 2022] DELETE /identity/v3/projects/c3e418bb8453416e9ee996a822f2d771 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:46.964457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047063f-5f62-4899-864e-ad01ff250952 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:46.965397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047063f-5f62-4899-864e-ad01ff250952 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:46.965897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047063f-5f62-4899-864e-ad01ff250952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:46.994107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f047063f-5f62-4899-864e-ad01ff250952 None None] MFA Rules not processed for user `bb9da9200f804a4a987f2cdb49f6801d`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:47.004611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f047063f-5f62-4899-864e-ad01ff250952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:47.009565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aac63-f412-4ff2-8b8e-333a41578ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:47.010248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aac63-f412-4ff2-8b8e-333a41578ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:47.010534 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aac63-f412-4ff2-8b8e-333a41578ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:47.010814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aac63-f412-4ff2-8b8e-333a41578ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:47.013711 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1c9aac63-f412-4ff2-8b8e-333a41578ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:47.099980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 878/1755] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:47.101527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047063f-5f62-4899-864e-ad01ff250952 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:47.104485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f047063f-5f62-4899-864e-ad01ff250952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:47.238965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aac63-f412-4ff2-8b8e-333a41578ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:47.240396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aac63-f412-4ff2-8b8e-333a41578ee8 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:47.259004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 878/1756] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:47.350812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047063f-5f62-4899-864e-ad01ff250952 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:47.366746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa55e3e-c72a-4564-9057-da1c099847bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:47.368399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55e3e-c72a-4564-9057-da1c099847bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:47.368628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55e3e-c72a-4564-9057-da1c099847bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:47.369079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55e3e-c72a-4564-9057-da1c099847bb admin admin] PATH_INFO: `/v3/users/cb747a6405d9433fabd75ae0325a51e1` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:47.371085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa55e3e-c72a-4564-9057-da1c099847bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb747a6405d9433fabd75ae0325a51e1)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:47.375220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa55e3e-c72a-4564-9057-da1c099847bb admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:47.507702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2fa55e3e-c72a-4564-9057-da1c099847bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb747a6405d9433fabd75ae0325a51e1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:47.531981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2fa55e3e-c72a-4564-9057-da1c099847bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb747a6405d9433fabd75ae0325a51e1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:47.547173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2fa55e3e-c72a-4564-9057-da1c099847bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb747a6405d9433fabd75ae0325a51e1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:47.549336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2fa55e3e-c72a-4564-9057-da1c099847bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb747a6405d9433fabd75ae0325a51e1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:47.550781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2fa55e3e-c72a-4564-9057-da1c099847bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb747a6405d9433fabd75ae0325a51e1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:47.596789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 879/1757] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:47 2022] DELETE /identity/v3/users/cb747a6405d9433fabd75ae0325a51e1 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:47.757335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aac63-f412-4ff2-8b8e-333a41578ee8 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:47.759520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1c9aac63-f412-4ff2-8b8e-333a41578ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:47.797317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aac63-f412-4ff2-8b8e-333a41578ee8 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:47.952078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:47.953882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:47.954167 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:47.954450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] PATH_INFO: `/v3/users/b8c07ce1d0814225b9640058c3163330` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:47.958508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c07ce1d0814225b9640058c3163330)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:47.967782 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:48.079926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c07ce1d0814225b9640058c3163330'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.080771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c07ce1d0814225b9640058c3163330'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.093777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c07ce1d0814225b9640058c3163330'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.104603 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c07ce1d0814225b9640058c3163330'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.105363 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c07ce1d0814225b9640058c3163330'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.134799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 879/1758] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:47 2022] DELETE /identity/v3/users/b8c07ce1d0814225b9640058c3163330 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:48.141700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd7b99-0230-4928-9398-d83d96d06b03 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:48.142174 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd7b99-0230-4928-9398-d83d96d06b03 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:48.142606 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd7b99-0230-4928-9398-d83d96d06b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:48.163409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-0dbd7b99-0230-4928-9398-d83d96d06b03 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:48.165594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0dbd7b99-0230-4928-9398-d83d96d06b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:48.236015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 880/1759] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:48.258298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:48.261290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:48.401727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd7b99-0230-4928-9398-d83d96d06b03 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:48.403446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0dbd7b99-0230-4928-9398-d83d96d06b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:48.414258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f3803-b8b2-44c0-8655-79ccc556c991 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:48.422115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52131ae-7914-491a-8a69-eccec7ea8963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:48.422901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52131ae-7914-491a-8a69-eccec7ea8963 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:48.423516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52131ae-7914-491a-8a69-eccec7ea8963 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:48.423803 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52131ae-7914-491a-8a69-eccec7ea8963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:48.437728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd7b99-0230-4928-9398-d83d96d06b03 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:48.452678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:48.452898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:48.453356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:48.453962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] PATH_INFO: `/v3/projects/da3b6bdcb46d42349041ffed886b1c02` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:48.455857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3b6bdcb46d42349041ffed886b1c02)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:48.461133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:48.501189 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52131ae-7914-491a-8a69-eccec7ea8963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:48.506573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52131ae-7914-491a-8a69-eccec7ea8963 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:48.559312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 880/1760] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:48.561319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52131ae-7914-491a-8a69-eccec7ea8963 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:48.564952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a52131ae-7914-491a-8a69-eccec7ea8963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:48.587352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52131ae-7914-491a-8a69-eccec7ea8963 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:48.643636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3b6bdcb46d42349041ffed886b1c02', 'request_id': 'req-c58026ce-9278-4a67-959a-0ef2fffd8672'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.666113 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3b6bdcb46d42349041ffed886b1c02', 'request_id': 'req-c58026ce-9278-4a67-959a-0ef2fffd8672'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.679326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3b6bdcb46d42349041ffed886b1c02', 'request_id': 'req-c58026ce-9278-4a67-959a-0ef2fffd8672'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.714944 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:48.715827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:48.716108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:48.716349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] The token cache is being invalidate because project da3b6bdcb46d42349041ffed886b1c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:48.716783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.718463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.733570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 881/1761] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:48 2022] DELETE /identity/v3/projects/da3b6bdcb46d42349041ffed886b1c02 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:06:48.733570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:48.736587 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] PATH_INFO: `/v3/projects/e7b7dcecab5d481c8f8d690f1ad5a3a0` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:48.737404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:48.740969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b7dcecab5d481c8f8d690f1ad5a3a0)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:48.746730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:48.763064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58026ce-9278-4a67-959a-0ef2fffd8672 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:48.778930 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731e503-2f7c-4000-9a95-ffb127c8ebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:48.780604 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e503-2f7c-4000-9a95-ffb127c8ebf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:48.780903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e503-2f7c-4000-9a95-ffb127c8ebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:48.781203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e503-2f7c-4000-9a95-ffb127c8ebf1 admin admin] PATH_INFO: `/v3/users/a7215583274143518ecde9091e93ce4a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:48.783807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731e503-2f7c-4000-9a95-ffb127c8ebf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7215583274143518ecde9091e93ce4a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:48.789376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731e503-2f7c-4000-9a95-ffb127c8ebf1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:48.840149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b7dcecab5d481c8f8d690f1ad5a3a0', 'request_id': 'req-9afece6b-2829-4095-ab14-fe3fa4201933'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.847953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b7dcecab5d481c8f8d690f1ad5a3a0', 'request_id': 'req-9afece6b-2829-4095-ab14-fe3fa4201933'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.856996 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b7dcecab5d481c8f8d690f1ad5a3a0', 'request_id': 'req-9afece6b-2829-4095-ab14-fe3fa4201933'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.882068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] The token cache is being invalidate because project e7b7dcecab5d481c8f8d690f1ad5a3a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:48.882590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.883959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9afece6b-2829-4095-ab14-fe3fa4201933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.886016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 881/1762] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:48 2022] DELETE /identity/v3/projects/e7b7dcecab5d481c8f8d690f1ad5a3a0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:48.890704 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c434c-7020-4e1e-8ea7-7f63c116d0af None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:48.891042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c434c-7020-4e1e-8ea7-7f63c116d0af None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:48.891844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c434c-7020-4e1e-8ea7-7f63c116d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:48.918307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c731e503-2f7c-4000-9a95-ffb127c8ebf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7215583274143518ecde9091e93ce4a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.944256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c731e503-2f7c-4000-9a95-ffb127c8ebf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7215583274143518ecde9091e93ce4a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.956387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-985c434c-7020-4e1e-8ea7-7f63c116d0af None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:48.958537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-985c434c-7020-4e1e-8ea7-7f63c116d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:48.967203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c731e503-2f7c-4000-9a95-ffb127c8ebf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7215583274143518ecde9091e93ce4a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.971974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c731e503-2f7c-4000-9a95-ffb127c8ebf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7215583274143518ecde9091e93ce4a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:48.972924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c731e503-2f7c-4000-9a95-ffb127c8ebf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7215583274143518ecde9091e93ce4a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:49.006571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 882/1763] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:48 2022] DELETE /identity/v3/users/a7215583274143518ecde9091e93ce4a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:49.125933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 882/1764] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:06:49.127236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63598a13-62d5-4eba-aeae-60c3a38ed315 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:49.127635 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63598a13-62d5-4eba-aeae-60c3a38ed315 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:49.128082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63598a13-62d5-4eba-aeae-60c3a38ed315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:49.189343 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-63598a13-62d5-4eba-aeae-60c3a38ed315 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:49.191420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-63598a13-62d5-4eba-aeae-60c3a38ed315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:49.343799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 883/1765] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:49.348539 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c434c-7020-4e1e-8ea7-7f63c116d0af None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:49.380825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c434c-7020-4e1e-8ea7-7f63c116d0af None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:49.400825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163c4a1-83a8-475f-bd18-52ebe537ea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:49.401521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163c4a1-83a8-475f-bd18-52ebe537ea9a admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:49.401814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163c4a1-83a8-475f-bd18-52ebe537ea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:49.402099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163c4a1-83a8-475f-bd18-52ebe537ea9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:49.405215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163c4a1-83a8-475f-bd18-52ebe537ea9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:49.405659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163c4a1-83a8-475f-bd18-52ebe537ea9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:49.410872 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163c4a1-83a8-475f-bd18-52ebe537ea9a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:49.431938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63598a13-62d5-4eba-aeae-60c3a38ed315 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:49.432209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 883/1766] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:49.452211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63598a13-62d5-4eba-aeae-60c3a38ed315 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:49.460664 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5124005-b41c-431d-8c76-84bdf6b9e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:49.462328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5124005-b41c-431d-8c76-84bdf6b9e583 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:49.462760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5124005-b41c-431d-8c76-84bdf6b9e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:49.463217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5124005-b41c-431d-8c76-84bdf6b9e583 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:49.464081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5124005-b41c-431d-8c76-84bdf6b9e583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:49.466266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5124005-b41c-431d-8c76-84bdf6b9e583 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:49.513654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 884/1767] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:49 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:49.519742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163c4a1-83a8-475f-bd18-52ebe537ea9a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:49.554469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163c4a1-83a8-475f-bd18-52ebe537ea9a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:49.778659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193d6c6-78be-409b-aa70-f793d51b272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:49.779845 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193d6c6-78be-409b-aa70-f793d51b272e admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:49.784486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193d6c6-78be-409b-aa70-f793d51b272e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:49.785395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193d6c6-78be-409b-aa70-f793d51b272e admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:49.787874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193d6c6-78be-409b-aa70-f793d51b272e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:49.798731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193d6c6-78be-409b-aa70-f793d51b272e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:49.856562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 884/1768] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:49 2022] POST /identity/v3/users => generated 291 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:49.858875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5124005-b41c-431d-8c76-84bdf6b9e583 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:49.884373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5124005-b41c-431d-8c76-84bdf6b9e583 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:49.916459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98865761-1a65-4f77-9f41-f5ebdf558ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:49.917595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865761-1a65-4f77-9f41-f5ebdf558ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:49.920222 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865761-1a65-4f77-9f41-f5ebdf558ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:49.920721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865761-1a65-4f77-9f41-f5ebdf558ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:49.925829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98865761-1a65-4f77-9f41-f5ebdf558ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:49.961392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98865761-1a65-4f77-9f41-f5ebdf558ab1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:49.968791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193d6c6-78be-409b-aa70-f793d51b272e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:49.970974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5193d6c6-78be-409b-aa70-f793d51b272e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:50.001140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 885/1769] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:50.005365 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98865761-1a65-4f77-9f41-f5ebdf558ab1 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:50.006578 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193d6c6-78be-409b-aa70-f793d51b272e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:50.027785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:50.031715 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:50.032238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98865761-1a65-4f77-9f41-f5ebdf558ab1 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:50.033227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:50.034402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] PATH_INFO: `/v3/projects/91692ecd81344805ac66c04b029e6a05` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:50.039495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91692ecd81344805ac66c04b029e6a05)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:50.042204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcc4c3-451c-4bc2-a400-9dc2f4eaad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:50.042884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcc4c3-451c-4bc2-a400-9dc2f4eaad0e admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:50.043320 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcc4c3-451c-4bc2-a400-9dc2f4eaad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:50.043489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcc4c3-451c-4bc2-a400-9dc2f4eaad0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:50.044258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcc4c3-451c-4bc2-a400-9dc2f4eaad0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:50.045850 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcc4c3-451c-4bc2-a400-9dc2f4eaad0e admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:50.050775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:50.078669 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 886/1770] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:50.079824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcc4c3-451c-4bc2-a400-9dc2f4eaad0e admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:50.104331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcc4c3-451c-4bc2-a400-9dc2f4eaad0e admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:50.115065 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3217e-6444-40f5-9137-3e8eafb7c4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:50.116204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3217e-6444-40f5-9137-3e8eafb7c4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:50.116674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3217e-6444-40f5-9137-3e8eafb7c4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:50.117093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3217e-6444-40f5-9137-3e8eafb7c4a9 admin admin] PATH_INFO: `/v3/projects/f33d9742eb03470e936dcbb02822c30a/users/555cd79af1b54595b45cb2aa1cd9f535/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:50.151173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3217e-6444-40f5-9137-3e8eafb7c4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33d9742eb03470e936dcbb02822c30a, user_id=555cd79af1b54595b45cb2aa1cd9f535, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:50.153930 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3217e-6444-40f5-9137-3e8eafb7c4a9 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:50.168083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91692ecd81344805ac66c04b029e6a05', 'request_id': 'req-d6fd71a5-f4af-4d0e-9589-d445b5b41004'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.175765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91692ecd81344805ac66c04b029e6a05', 'request_id': 'req-d6fd71a5-f4af-4d0e-9589-d445b5b41004'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.175964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 887/1771] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:50 2022] PUT /identity/v3/projects/f33d9742eb03470e936dcbb02822c30a/users/555cd79af1b54595b45cb2aa1cd9f535/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:50.180868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3217e-6444-40f5-9137-3e8eafb7c4a9 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:50.191006 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-fdc3217e-6444-40f5-9137-3e8eafb7c4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:50.196458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91692ecd81344805ac66c04b029e6a05', 'request_id': 'req-d6fd71a5-f4af-4d0e-9589-d445b5b41004'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.233844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] The token cache is being invalidate because project 91692ecd81344805ac66c04b029e6a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:50.246090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.248586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-d6fd71a5-f4af-4d0e-9589-d445b5b41004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.252109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 885/1772] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:49 2022] DELETE /identity/v3/projects/91692ecd81344805ac66c04b029e6a05 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:50.256572 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493835b-4486-4b67-98d4-fe22e3828b54 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:50.258130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493835b-4486-4b67-98d4-fe22e3828b54 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:50.259563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493835b-4486-4b67-98d4-fe22e3828b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:50.347854 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c493835b-4486-4b67-98d4-fe22e3828b54 None None] MFA Rules not processed for user `555cd79af1b54595b45cb2aa1cd9f535`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:50.359480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c493835b-4486-4b67-98d4-fe22e3828b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:50.404484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3217e-6444-40f5-9137-3e8eafb7c4a9 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:50.409583 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:50.410826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:50.411126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:50.411581 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] PATH_INFO: `/v3/projects/5672226d78fe4439b27cf16e96bf713f` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:50.413724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5672226d78fe4439b27cf16e96bf713f)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:50.417464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:50.504364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5672226d78fe4439b27cf16e96bf713f', 'request_id': 'req-f92e91c9-7503-48c0-8d13-f6909204ae82'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.525094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5672226d78fe4439b27cf16e96bf713f', 'request_id': 'req-f92e91c9-7503-48c0-8d13-f6909204ae82'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.535978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5672226d78fe4439b27cf16e96bf713f', 'request_id': 'req-f92e91c9-7503-48c0-8d13-f6909204ae82'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.564578 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 886/1773] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:50.569672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa65e8c-c60d-4ae2-9d2c-473d5c54aa29 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:50.569892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa65e8c-c60d-4ae2-9d2c-473d5c54aa29 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:50.572943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa65e8c-c60d-4ae2-9d2c-473d5c54aa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:50.573378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] The token cache is being invalidate because project 5672226d78fe4439b27cf16e96bf713f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:50.590807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.593211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.604032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 888/1774] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:50 2022] DELETE /identity/v3/projects/5672226d78fe4439b27cf16e96bf713f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:50.607258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:50.610956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:50.634492 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-4aa65e8c-c60d-4ae2-9d2c-473d5c54aa29 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:50.636311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4aa65e8c-c60d-4ae2-9d2c-473d5c54aa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:50.800699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 887/1775] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:50.802271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa65e8c-c60d-4ae2-9d2c-473d5c54aa29 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:50.806521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4aa65e8c-c60d-4ae2-9d2c-473d5c54aa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:50.825163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa65e8c-c60d-4ae2-9d2c-473d5c54aa29 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:50.842537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:50.849316 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:50.849710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:50.850099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] PATH_INFO: `/v3/users/0b130a6ed3c04e0f9514a7ca38e28119` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:50.854329 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b130a6ed3c04e0f9514a7ca38e28119)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:50.856450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:50.857085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e91c9-7503-48c0-8d13-f6909204ae82 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:50.875762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd80fbe-396f-4b35-b2f8-284170b72aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:50.876645 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80fbe-396f-4b35-b2f8-284170b72aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:50.876948 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80fbe-396f-4b35-b2f8-284170b72aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:50.877229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd80fbe-396f-4b35-b2f8-284170b72aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:50.877935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd80fbe-396f-4b35-b2f8-284170b72aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:50.880213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd80fbe-396f-4b35-b2f8-284170b72aa0 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:50.949811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 889/1776] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:50 2022] POST /identity/v3/projects => generated 383 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:50.949811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e6a9d-98d3-4fe0-aa7e-457dedff31d8 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:50.949811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e6a9d-98d3-4fe0-aa7e-457dedff31d8 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:50.949811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e6a9d-98d3-4fe0-aa7e-457dedff31d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:50.955790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b130a6ed3c04e0f9514a7ca38e28119'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.964923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b130a6ed3c04e0f9514a7ca38e28119'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.980792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b130a6ed3c04e0f9514a7ca38e28119'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:50.991087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-cf8e6a9d-98d3-4fe0-aa7e-457dedff31d8 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:50.992528 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-cf8e6a9d-98d3-4fe0-aa7e-457dedff31d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:51.003319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b130a6ed3c04e0f9514a7ca38e28119'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:51.009773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b130a6ed3c04e0f9514a7ca38e28119'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:51.063710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 888/1777] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:50 2022] DELETE /identity/v3/users/0b130a6ed3c04e0f9514a7ca38e28119 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:51.065371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:51.067350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:51.153525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 890/1778] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:51.158148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e6a9d-98d3-4fe0-aa7e-457dedff31d8 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:51.195397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e6a9d-98d3-4fe0-aa7e-457dedff31d8 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:51.400540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a18d43-a7da-49ba-aec5-7836ca6db886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:51.401239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a18d43-a7da-49ba-aec5-7836ca6db886 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:51.401520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a18d43-a7da-49ba-aec5-7836ca6db886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:51.401796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a18d43-a7da-49ba-aec5-7836ca6db886 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:51.402541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a18d43-a7da-49ba-aec5-7836ca6db886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:51.402853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a18d43-a7da-49ba-aec5-7836ca6db886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:51.404613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a18d43-a7da-49ba-aec5-7836ca6db886 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:51.444069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 891/1779] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:51.454386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a18d43-a7da-49ba-aec5-7836ca6db886 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:51.488369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a18d43-a7da-49ba-aec5-7836ca6db886 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:51.509112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aac119-7a69-4a62-aabe-3dfe268e6baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:51.510039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac119-7a69-4a62-aabe-3dfe268e6baa admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:51.510469 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac119-7a69-4a62-aabe-3dfe268e6baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:51.510913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac119-7a69-4a62-aabe-3dfe268e6baa admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:51.511814 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aac119-7a69-4a62-aabe-3dfe268e6baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:51.515854 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aac119-7a69-4a62-aabe-3dfe268e6baa admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:51.583598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd3e4f-0c41-4ce6-b221-4cbcc66d6f00 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:51.589121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89da4ce-cc65-4047-bba9-600fe467b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:51.589938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da4ce-cc65-4047-bba9-600fe467b7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:51.590289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da4ce-cc65-4047-bba9-600fe467b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:51.590543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 892/1780] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:51 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:51.594672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da4ce-cc65-4047-bba9-600fe467b7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:51.594672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89da4ce-cc65-4047-bba9-600fe467b7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:51.598122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89da4ce-cc65-4047-bba9-600fe467b7d9 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:51.598525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aac119-7a69-4a62-aabe-3dfe268e6baa admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:51.628624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 889/1781] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:51 2022] POST /identity/v3/users => generated 298 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:51.632228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89da4ce-cc65-4047-bba9-600fe467b7d9 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:51.673712 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89da4ce-cc65-4047-bba9-600fe467b7d9 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:51.749215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aac119-7a69-4a62-aabe-3dfe268e6baa admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:51.762106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9438eec-8f00-433e-b031-d06ec8310be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:51.762999 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438eec-8f00-433e-b031-d06ec8310be2 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:51.763291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438eec-8f00-433e-b031-d06ec8310be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:51.763585 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438eec-8f00-433e-b031-d06ec8310be2 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:51.764813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9438eec-8f00-433e-b031-d06ec8310be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:51.768552 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9438eec-8f00-433e-b031-d06ec8310be2 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:51.817572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 893/1782] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:51 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:51.819140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9438eec-8f00-433e-b031-d06ec8310be2 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:51.845708 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9438eec-8f00-433e-b031-d06ec8310be2 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:51.860826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ed96b-016c-4b5d-bb62-90ef025a6ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:51.861755 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ed96b-016c-4b5d-bb62-90ef025a6ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:51.862171 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ed96b-016c-4b5d-bb62-90ef025a6ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:51.862544 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cf4ef-ccd2-4f6f-85b8-414d973dfef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:51.862732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ed96b-016c-4b5d-bb62-90ef025a6ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:51.863233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf4ef-ccd2-4f6f-85b8-414d973dfef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:51.863521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf4ef-ccd2-4f6f-85b8-414d973dfef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:51.863875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cf4ef-ccd2-4f6f-85b8-414d973dfef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:51.864220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ed96b-016c-4b5d-bb62-90ef025a6ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:51.864695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cf4ef-ccd2-4f6f-85b8-414d973dfef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:51.866376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cf4ef-ccd2-4f6f-85b8-414d973dfef4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:51.866809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ed96b-016c-4b5d-bb62-90ef025a6ac2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:51.896130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 894/1783] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:06:51.897130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cf4ef-ccd2-4f6f-85b8-414d973dfef4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:51.917466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cf4ef-ccd2-4f6f-85b8-414d973dfef4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:51.924952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 890/1784] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:51.926505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ed96b-016c-4b5d-bb62-90ef025a6ac2 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:51.933369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4760a-b533-4219-8f5c-c856df49f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:51.934067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4760a-b533-4219-8f5c-c856df49f926 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:51.934357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4760a-b533-4219-8f5c-c856df49f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:51.934638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4760a-b533-4219-8f5c-c856df49f926 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:51.935383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4760a-b533-4219-8f5c-c856df49f926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:51.937088 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4760a-b533-4219-8f5c-c856df49f926 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:51.950452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ed96b-016c-4b5d-bb62-90ef025a6ac2 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:51.963167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 895/1785] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:06:51.966494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4760a-b533-4219-8f5c-c856df49f926 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:51.970505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9acbf3-2767-4669-a386-2d9d736a6f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:51.971419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9acbf3-2767-4669-a386-2d9d736a6f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:51.971704 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9acbf3-2767-4669-a386-2d9d736a6f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:51.971981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9acbf3-2767-4669-a386-2d9d736a6f22 admin admin] PATH_INFO: `/v3/projects/1630af89c95f4d219b22b6507835cf24/users/7146b7bbe213465cafa30bd6aa6b8798/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:51.990307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4760a-b533-4219-8f5c-c856df49f926 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:51.998572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fc699-5f2e-4000-beee-b5ea3f10aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:51.999509 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fc699-5f2e-4000-beee-b5ea3f10aeb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:51.999792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fc699-5f2e-4000-beee-b5ea3f10aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.000068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fc699-5f2e-4000-beee-b5ea3f10aeb1 admin admin] PATH_INFO: `/v3/projects/14052434a9104a7ba8fba77c6bd40f2f/users/610fd5f1fefa467c9ff612e0fc789f8a/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.006425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9acbf3-2767-4669-a386-2d9d736a6f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1630af89c95f4d219b22b6507835cf24, user_id=7146b7bbe213465cafa30bd6aa6b8798, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:52.010212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9acbf3-2767-4669-a386-2d9d736a6f22 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:52.037212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fc699-5f2e-4000-beee-b5ea3f10aeb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14052434a9104a7ba8fba77c6bd40f2f, user_id=610fd5f1fefa467c9ff612e0fc789f8a, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:52.043391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fc699-5f2e-4000-beee-b5ea3f10aeb1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:52.054233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 891/1786] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:51 2022] PUT /identity/v3/projects/1630af89c95f4d219b22b6507835cf24/users/7146b7bbe213465cafa30bd6aa6b8798/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:06:52.056946 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9acbf3-2767-4669-a386-2d9d736a6f22 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:52.076960 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 896/1787] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:51 2022] PUT /identity/v3/projects/14052434a9104a7ba8fba77c6bd40f2f/users/610fd5f1fefa467c9ff612e0fc789f8a/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:52.085967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb13848-04c8-485e-98e2-dee3f8992db1 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:52.087089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb13848-04c8-485e-98e2-dee3f8992db1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.087598 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb13848-04c8-485e-98e2-dee3f8992db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.165848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-7fb13848-04c8-485e-98e2-dee3f8992db1 None None] MFA Rules not processed for user `610fd5f1fefa467c9ff612e0fc789f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:52.172362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-7fb13848-04c8-485e-98e2-dee3f8992db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:52.199222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9acbf3-2767-4669-a386-2d9d736a6f22 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:52.359393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb1b5c-3f97-4b2e-a4c8-9f2671bd1977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:52.360138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1b5c-3f97-4b2e-a4c8-9f2671bd1977 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:52.360505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1b5c-3f97-4b2e-a4c8-9f2671bd1977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.361065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb1b5c-3f97-4b2e-a4c8-9f2671bd1977 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.362580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb1b5c-3f97-4b2e-a4c8-9f2671bd1977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:52.364645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb1b5c-3f97-4b2e-a4c8-9f2671bd1977 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:52.380528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 892/1788] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:52.381851 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb1b5c-3f97-4b2e-a4c8-9f2671bd1977 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:52.391998 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 897/1789] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:06:52.395534 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb1b5c-3f97-4b2e-a4c8-9f2671bd1977 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:52.395930 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb13848-04c8-485e-98e2-dee3f8992db1 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:52.404097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5eac6-d216-4344-8c5d-4d1d04d0e643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:52.404903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5eac6-d216-4344-8c5d-4d1d04d0e643 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:52.406464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5eac6-d216-4344-8c5d-4d1d04d0e643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.406732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5eac6-d216-4344-8c5d-4d1d04d0e643 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.407672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5eac6-d216-4344-8c5d-4d1d04d0e643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:52.411141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5eac6-d216-4344-8c5d-4d1d04d0e643 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:52.422686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb13848-04c8-485e-98e2-dee3f8992db1 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:52.428735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45314b-9318-4592-b9f7-be9197652202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:52.432056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45314b-9318-4592-b9f7-be9197652202 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:52.432589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45314b-9318-4592-b9f7-be9197652202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.433709 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45314b-9318-4592-b9f7-be9197652202 admin admin] PATH_INFO: `/v3/projects/1630af89c95f4d219b22b6507835cf24/users/7146b7bbe213465cafa30bd6aa6b8798/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.437062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45314b-9318-4592-b9f7-be9197652202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1630af89c95f4d219b22b6507835cf24, user_id=7146b7bbe213465cafa30bd6aa6b8798, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:52.441211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45314b-9318-4592-b9f7-be9197652202 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:52.466810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 898/1790] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:52 2022] PUT /identity/v3/projects/1630af89c95f4d219b22b6507835cf24/users/7146b7bbe213465cafa30bd6aa6b8798/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:52.486181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb449e0-74d2-4f3e-8206-2efad4a3ad51 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:52.486495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb449e0-74d2-4f3e-8206-2efad4a3ad51 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.486760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb449e0-74d2-4f3e-8206-2efad4a3ad51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.491886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 893/1791] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:52 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:52.504672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5eac6-d216-4344-8c5d-4d1d04d0e643 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:52.552468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ceb449e0-74d2-4f3e-8206-2efad4a3ad51 None None] MFA Rules not processed for user `7146b7bbe213465cafa30bd6aa6b8798`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:52.556642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ceb449e0-74d2-4f3e-8206-2efad4a3ad51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:52.590269 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5eac6-d216-4344-8c5d-4d1d04d0e643 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:52.595482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858fe45-790e-4b01-bfe6-c51af9a0d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:52.596390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858fe45-790e-4b01-bfe6-c51af9a0d2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:52.596742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858fe45-790e-4b01-bfe6-c51af9a0d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.597788 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858fe45-790e-4b01-bfe6-c51af9a0d2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.598619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858fe45-790e-4b01-bfe6-c51af9a0d2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:52.601053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858fe45-790e-4b01-bfe6-c51af9a0d2f1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:52.634201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 894/1792] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:52 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:52.635863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858fe45-790e-4b01-bfe6-c51af9a0d2f1 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:52.652141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858fe45-790e-4b01-bfe6-c51af9a0d2f1 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:52.675334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f90a60-24ef-497b-8b5c-0ec30407f9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:52.677398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f90a60-24ef-497b-8b5c-0ec30407f9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:52.677695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f90a60-24ef-497b-8b5c-0ec30407f9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.679502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f90a60-24ef-497b-8b5c-0ec30407f9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.682090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f90a60-24ef-497b-8b5c-0ec30407f9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:52.685562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f90a60-24ef-497b-8b5c-0ec30407f9e6 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:52.709852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 895/1793] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:52.714007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f90a60-24ef-497b-8b5c-0ec30407f9e6 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:52.735874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f90a60-24ef-497b-8b5c-0ec30407f9e6 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:52.743024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 899/1794] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:52.753703 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb449e0-74d2-4f3e-8206-2efad4a3ad51 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:52.755354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46267c0-0255-4ac2-bd36-bdbdec468ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:52.755939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ceb449e0-74d2-4f3e-8206-2efad4a3ad51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:52.756531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46267c0-0255-4ac2-bd36-bdbdec468ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:52.757041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46267c0-0255-4ac2-bd36-bdbdec468ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.757551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46267c0-0255-4ac2-bd36-bdbdec468ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.759855 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46267c0-0255-4ac2-bd36-bdbdec468ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:52.761830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46267c0-0255-4ac2-bd36-bdbdec468ae2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:52.779771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 896/1795] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:52.783967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46267c0-0255-4ac2-bd36-bdbdec468ae2 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:52.799808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46267c0-0255-4ac2-bd36-bdbdec468ae2 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:52.808505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55755e0b-f9f2-4590-b0b1-78a586be7970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:52.810249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55755e0b-f9f2-4590-b0b1-78a586be7970 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:52.810546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55755e0b-f9f2-4590-b0b1-78a586be7970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.810822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55755e0b-f9f2-4590-b0b1-78a586be7970 admin admin] PATH_INFO: `/v3/projects/327ba4cca0d74a7c9459985d3be3182e/users/a07e5aba0f9644d390445c30cdfdbece/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.838056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55755e0b-f9f2-4590-b0b1-78a586be7970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327ba4cca0d74a7c9459985d3be3182e, user_id=a07e5aba0f9644d390445c30cdfdbece, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:52.841190 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55755e0b-f9f2-4590-b0b1-78a586be7970 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:52.841754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb449e0-74d2-4f3e-8206-2efad4a3ad51 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:52.847425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb1acf-1a37-4745-a880-0093b7c0a6c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:52.848568 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb1acf-1a37-4745-a880-0093b7c0a6c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:52.848993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb1acf-1a37-4745-a880-0093b7c0a6c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.849335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb1acf-1a37-4745-a880-0093b7c0a6c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.860978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb1acf-1a37-4745-a880-0093b7c0a6c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:52.862689 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb1acf-1a37-4745-a880-0093b7c0a6c0 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:52.865033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 897/1796] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:52 2022] PUT /identity/v3/projects/327ba4cca0d74a7c9459985d3be3182e/users/a07e5aba0f9644d390445c30cdfdbece/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:52.876595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd795-af33-4eea-a461-8c6797f4acc5 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:52.876882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd795-af33-4eea-a461-8c6797f4acc5 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:52.877159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd795-af33-4eea-a461-8c6797f4acc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:52.901633 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 900/1797] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:06:52.929393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-937dd795-af33-4eea-a461-8c6797f4acc5 None None] MFA Rules not processed for user `a07e5aba0f9644d390445c30cdfdbece`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:52.931050 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-937dd795-af33-4eea-a461-8c6797f4acc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:53.012254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb1acf-1a37-4745-a880-0093b7c0a6c0 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:53.025707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb1acf-1a37-4745-a880-0093b7c0a6c0 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:53.035493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 898/1798] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:53.036955 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dd795-af33-4eea-a461-8c6797f4acc5 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:53.121564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87755a-f7e9-47b9-8b92-8aef501a947b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:53.122333 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87755a-f7e9-47b9-8b92-8aef501a947b service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:53.122620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87755a-f7e9-47b9-8b92-8aef501a947b service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:53.122944 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87755a-f7e9-47b9-8b92-8aef501a947b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:53.125790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-7a87755a-f7e9-47b9-8b92-8aef501a947b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:53.193291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dd795-af33-4eea-a461-8c6797f4acc5 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:53.207107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6b6ac-c241-4bcf-aa8a-eff93eb1f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:53.207791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6b6ac-c241-4bcf-aa8a-eff93eb1f50a admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:53.208072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6b6ac-c241-4bcf-aa8a-eff93eb1f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:53.208434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6b6ac-c241-4bcf-aa8a-eff93eb1f50a admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:53.209114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6b6ac-c241-4bcf-aa8a-eff93eb1f50a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:53.210527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87755a-f7e9-47b9-8b92-8aef501a947b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:53.211706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6b6ac-c241-4bcf-aa8a-eff93eb1f50a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:53.213471 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87755a-f7e9-47b9-8b92-8aef501a947b service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:53.230558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 901/1799] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:53.232268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ad712-0d7a-4e66-9abd-e0e035bf7631 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:53.232562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ad712-0d7a-4e66-9abd-e0e035bf7631 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:53.232841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ad712-0d7a-4e66-9abd-e0e035bf7631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:53.261328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a96ad712-0d7a-4e66-9abd-e0e035bf7631 None None] MFA Rules not processed for user `586e15d5d16543e6b70c87fbf9079e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:53.263325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a96ad712-0d7a-4e66-9abd-e0e035bf7631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:53.268815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 899/1800] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:53 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:53.272889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6b6ac-c241-4bcf-aa8a-eff93eb1f50a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:53.346129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 902/1801] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:53.403615 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6b6ac-c241-4bcf-aa8a-eff93eb1f50a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:53.410374 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a9838-4306-4157-b214-d3b942ff2b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:53.410956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a9838-4306-4157-b214-d3b942ff2b2d admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:53.411784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a9838-4306-4157-b214-d3b942ff2b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:53.412013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a9838-4306-4157-b214-d3b942ff2b2d admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:53.417584 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a9838-4306-4157-b214-d3b942ff2b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:53.420582 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a9838-4306-4157-b214-d3b942ff2b2d admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:53.466887 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 900/1802] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:53 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:06:53.470444 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ad712-0d7a-4e66-9abd-e0e035bf7631 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:53.490380 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ad712-0d7a-4e66-9abd-e0e035bf7631 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:53.499947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ad1bc-d5b2-45ff-9a01-383f060f0d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:53.501104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ad1bc-d5b2-45ff-9a01-383f060f0d1a admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:53.501491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ad1bc-d5b2-45ff-9a01-383f060f0d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:53.501939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ad1bc-d5b2-45ff-9a01-383f060f0d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:53.504223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ad1bc-d5b2-45ff-9a01-383f060f0d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:53.509254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ad1bc-d5b2-45ff-9a01-383f060f0d1a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:53.530378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 903/1803] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:53.534459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a9838-4306-4157-b214-d3b942ff2b2d admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:53.554759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a9838-4306-4157-b214-d3b942ff2b2d admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:53.564525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b535a45-ae95-4e2f-a0d9-f7d200b636db None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:53.565577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b535a45-ae95-4e2f-a0d9-f7d200b636db None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:53.565871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b535a45-ae95-4e2f-a0d9-f7d200b636db None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:53.567686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 904/1804] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 12:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 12:06:53.574912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320603b1-3d77-46c4-9ad8-64993384e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:53.576758 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320603b1-3d77-46c4-9ad8-64993384e19e admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:53.577101 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320603b1-3d77-46c4-9ad8-64993384e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:53.577476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320603b1-3d77-46c4-9ad8-64993384e19e admin admin] PATH_INFO: `/v3/projects/2d588a5b84874c1692a2a53e35bb551e/users/33e0604243394749a655aadfdc86d319/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:53.594127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c2520-3fd3-4b51-b90e-cd6acbb572b9 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:53.594405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c2520-3fd3-4b51-b90e-cd6acbb572b9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:53.594688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c2520-3fd3-4b51-b90e-cd6acbb572b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:53.640356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320603b1-3d77-46c4-9ad8-64993384e19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d588a5b84874c1692a2a53e35bb551e, user_id=33e0604243394749a655aadfdc86d319, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:53.643092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-765c2520-3fd3-4b51-b90e-cd6acbb572b9 None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:53.644367 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-765c2520-3fd3-4b51-b90e-cd6acbb572b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:53.646873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320603b1-3d77-46c4-9ad8-64993384e19e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:53.694817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 901/1805] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:53 2022] PUT /identity/v3/projects/2d588a5b84874c1692a2a53e35bb551e/users/33e0604243394749a655aadfdc86d319/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:53.696423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320603b1-3d77-46c4-9ad8-64993384e19e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:53.708212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-320603b1-3d77-46c4-9ad8-64993384e19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:53.911370 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 905/1806] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 12:06:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:06:53.912305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c2520-3fd3-4b51-b90e-cd6acbb572b9 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:53.952559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c2520-3fd3-4b51-b90e-cd6acbb572b9 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:53.956710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320603b1-3d77-46c4-9ad8-64993384e19e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:53.969321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32510e9f-4a60-4c64-b216-2c61933fbdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:53.970345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510e9f-4a60-4c64-b216-2c61933fbdee admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:53.970796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510e9f-4a60-4c64-b216-2c61933fbdee admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:53.971192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510e9f-4a60-4c64-b216-2c61933fbdee admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:53.972393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32510e9f-4a60-4c64-b216-2c61933fbdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:53.972836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:53.973918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:53.974382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:53.975014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32510e9f-4a60-4c64-b216-2c61933fbdee admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:53.976470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] PATH_INFO: `/v3/projects/cda6be2525c64e87922fa48c92fe7522` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:53.982556 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda6be2525c64e87922fa48c92fe7522)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:53.986108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:54.019398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 906/1807] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:54.029284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32510e9f-4a60-4c64-b216-2c61933fbdee admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:54.072762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32510e9f-4a60-4c64-b216-2c61933fbdee admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:54.074509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda6be2525c64e87922fa48c92fe7522', 'request_id': 'req-fe7952f1-4eef-4c94-99ab-10ea1a738b52'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:54.081915 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda6be2525c64e87922fa48c92fe7522', 'request_id': 'req-fe7952f1-4eef-4c94-99ab-10ea1a738b52'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:54.090060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda6be2525c64e87922fa48c92fe7522', 'request_id': 'req-fe7952f1-4eef-4c94-99ab-10ea1a738b52'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:54.108752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] The token cache is being invalidate because project cda6be2525c64e87922fa48c92fe7522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:54.109429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:54.110600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:54.112725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 902/1808] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:53 2022] DELETE /identity/v3/projects/cda6be2525c64e87922fa48c92fe7522 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:54.119131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:54.121698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:54.220294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf70590-3cc6-4faa-a14c-b14c7ea8ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:54.221208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70590-3cc6-4faa-a14c-b14c7ea8ff20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:54.221491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70590-3cc6-4faa-a14c-b14c7ea8ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:54.221784 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70590-3cc6-4faa-a14c-b14c7ea8ff20 admin admin] PATH_INFO: `/v3/projects/2d588a5b84874c1692a2a53e35bb551e/users/33e0604243394749a655aadfdc86d319/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:54.222051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7952f1-4eef-4c94-99ab-10ea1a738b52 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:54.223891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf70590-3cc6-4faa-a14c-b14c7ea8ff20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d588a5b84874c1692a2a53e35bb551e, user_id=33e0604243394749a655aadfdc86d319, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:54.226611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf70590-3cc6-4faa-a14c-b14c7ea8ff20 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:54.229424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:54.230635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:54.231232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:54.231442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] PATH_INFO: `/v3/users/ba35b3af8d12470682765bb42f957a6a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:54.233386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba35b3af8d12470682765bb42f957a6a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:54.235654 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:54.252726 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 907/1809] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:54 2022] PUT /identity/v3/projects/2d588a5b84874c1692a2a53e35bb551e/users/33e0604243394749a655aadfdc86d319/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:54.272841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9ffd-6cd2-4c69-81e0-e92ce7d2efbd None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:54.274289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9ffd-6cd2-4c69-81e0-e92ce7d2efbd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:54.275734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9ffd-6cd2-4c69-81e0-e92ce7d2efbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:54.323825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-960f9ffd-6cd2-4c69-81e0-e92ce7d2efbd None None] MFA Rules not processed for user `33e0604243394749a655aadfdc86d319`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:54.325429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-960f9ffd-6cd2-4c69-81e0-e92ce7d2efbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:54.350311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba35b3af8d12470682765bb42f957a6a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:54.351783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba35b3af8d12470682765bb42f957a6a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:54.397132 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba35b3af8d12470682765bb42f957a6a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:54.418762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba35b3af8d12470682765bb42f957a6a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:54.419628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba35b3af8d12470682765bb42f957a6a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:54.435721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 908/1810] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:54.449816 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 903/1811] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:54 2022] DELETE /identity/v3/users/ba35b3af8d12470682765bb42f957a6a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:06:54.455005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9ffd-6cd2-4c69-81e0-e92ce7d2efbd None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:54.460611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-960f9ffd-6cd2-4c69-81e0-e92ce7d2efbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:54.542149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9ffd-6cd2-4c69-81e0-e92ce7d2efbd None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:54.610091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b959a1-cb01-42a8-9a29-752e4cc609b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:54.610916 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b959a1-cb01-42a8-9a29-752e4cc609b7 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:54.611205 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b959a1-cb01-42a8-9a29-752e4cc609b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:54.611541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b959a1-cb01-42a8-9a29-752e4cc609b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:54.613500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-90b959a1-cb01-42a8-9a29-752e4cc609b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:54.725581 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b959a1-cb01-42a8-9a29-752e4cc609b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:54.727652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b959a1-cb01-42a8-9a29-752e4cc609b7 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:54.755192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 909/1812] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:06:54.806182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:54.807908 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:54.824754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc8240-9c12-4040-ad01-8bfd5bf5defd admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:54.830081 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87d404-21f5-449c-8ca6-d9b186f64afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:54.831245 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d404-21f5-449c-8ca6-d9b186f64afa service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:54.831541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d404-21f5-449c-8ca6-d9b186f64afa service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:54.831882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87d404-21f5-449c-8ca6-d9b186f64afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:54.834075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7e87d404-21f5-449c-8ca6-d9b186f64afa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:54.912969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87d404-21f5-449c-8ca6-d9b186f64afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:54.914537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87d404-21f5-449c-8ca6-d9b186f64afa service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:54.924685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 904/1813] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:55.240099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b959a1-cb01-42a8-9a29-752e4cc609b7 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:55.243111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-90b959a1-cb01-42a8-9a29-752e4cc609b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:55.373919 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b959a1-cb01-42a8-9a29-752e4cc609b7 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:55.384967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da94722-67de-49ed-9e17-3e2942953edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:55.385905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da94722-67de-49ed-9e17-3e2942953edc service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:55.386479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da94722-67de-49ed-9e17-3e2942953edc service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:55.386479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da94722-67de-49ed-9e17-3e2942953edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:55.389246 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6da94722-67de-49ed-9e17-3e2942953edc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:55.412550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da94722-67de-49ed-9e17-3e2942953edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:55.416133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da94722-67de-49ed-9e17-3e2942953edc service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:55.446799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 910/1814] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:56.178047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87d404-21f5-449c-8ca6-d9b186f64afa service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:56.179716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7e87d404-21f5-449c-8ca6-d9b186f64afa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:56.300667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87d404-21f5-449c-8ca6-d9b186f64afa service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:56.308923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:56.310327 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:56.310939 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:56.311362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] PATH_INFO: `/v3/projects/c6aafb0c1ff841e3bae62c7084212ad5` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:56.313120 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6aafb0c1ff841e3bae62c7084212ad5)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:56.315678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:56.467273 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6aafb0c1ff841e3bae62c7084212ad5', 'request_id': 'req-ca2c3c99-28ab-43db-af28-174147e7976d'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:56.494255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6aafb0c1ff841e3bae62c7084212ad5', 'request_id': 'req-ca2c3c99-28ab-43db-af28-174147e7976d'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:56.532581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6aafb0c1ff841e3bae62c7084212ad5', 'request_id': 'req-ca2c3c99-28ab-43db-af28-174147e7976d'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:56.577206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da94722-67de-49ed-9e17-3e2942953edc service nova] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:56.578632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6da94722-67de-49ed-9e17-3e2942953edc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:56.589087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] The token cache is being invalidate because project c6aafb0c1ff841e3bae62c7084212ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:56.589750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:56.590780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ca2c3c99-28ab-43db-af28-174147e7976d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:56.593187 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 905/1815] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:56 2022] DELETE /identity/v3/projects/c6aafb0c1ff841e3bae62c7084212ad5 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:56.602552 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab58af-7003-414e-a693-7ed696faaa20 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:56.603187 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab58af-7003-414e-a693-7ed696faaa20 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:56.603688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab58af-7003-414e-a693-7ed696faaa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:56.612724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da94722-67de-49ed-9e17-3e2942953edc service nova] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:56.658498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-01ab58af-7003-414e-a693-7ed696faaa20 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:56.659869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-01ab58af-7003-414e-a693-7ed696faaa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:56.785666 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e0edf-67a5-469d-a63e-eef9d74ff534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:56.801917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e0edf-67a5-469d-a63e-eef9d74ff534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:56.816978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e0edf-67a5-469d-a63e-eef9d74ff534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:56.819298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 906/1816] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:56.820234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e0edf-67a5-469d-a63e-eef9d74ff534 admin admin] PATH_INFO: `/v3/users/555cd79af1b54595b45cb2aa1cd9f535` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:56.826860 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e0edf-67a5-469d-a63e-eef9d74ff534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=555cd79af1b54595b45cb2aa1cd9f535)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:56.831317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e0edf-67a5-469d-a63e-eef9d74ff534 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:56.833473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca85a1-bed9-4430-8516-e4705488ee66 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:56.834139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca85a1-bed9-4430-8516-e4705488ee66 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:56.834541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca85a1-bed9-4430-8516-e4705488ee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:56.913097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-daca85a1-bed9-4430-8516-e4705488ee66 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:56.914497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-daca85a1-bed9-4430-8516-e4705488ee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:56.933754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 907/1817] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:56.939469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca85a1-bed9-4430-8516-e4705488ee66 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:56.969170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca85a1-bed9-4430-8516-e4705488ee66 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:56.976292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab258a6f-a51e-4fe0-8cba-02132b062e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:56.978187 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab258a6f-a51e-4fe0-8cba-02132b062e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:56.978689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab258a6f-a51e-4fe0-8cba-02132b062e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:56.979038 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab258a6f-a51e-4fe0-8cba-02132b062e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:56.984962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab258a6f-a51e-4fe0-8cba-02132b062e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:06:56.984962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab258a6f-a51e-4fe0-8cba-02132b062e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:56.984962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab258a6f-a51e-4fe0-8cba-02132b062e7c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:57.031524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e72e0edf-67a5-469d-a63e-eef9d74ff534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555cd79af1b54595b45cb2aa1cd9f535'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:57.048119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 908/1818] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:06:57.049574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab258a6f-a51e-4fe0-8cba-02132b062e7c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:57.064277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e72e0edf-67a5-469d-a63e-eef9d74ff534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555cd79af1b54595b45cb2aa1cd9f535'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:57.066980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab258a6f-a51e-4fe0-8cba-02132b062e7c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:57.075925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442db83c-04cd-406d-9c93-fd4614ace441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:57.076899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442db83c-04cd-406d-9c93-fd4614ace441 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:57.079266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442db83c-04cd-406d-9c93-fd4614ace441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:57.079643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442db83c-04cd-406d-9c93-fd4614ace441 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:57.081357 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442db83c-04cd-406d-9c93-fd4614ace441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:57.084757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442db83c-04cd-406d-9c93-fd4614ace441 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:57.089840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e72e0edf-67a5-469d-a63e-eef9d74ff534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555cd79af1b54595b45cb2aa1cd9f535'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:57.090788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e72e0edf-67a5-469d-a63e-eef9d74ff534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555cd79af1b54595b45cb2aa1cd9f535'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:57.091631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e72e0edf-67a5-469d-a63e-eef9d74ff534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555cd79af1b54595b45cb2aa1cd9f535'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:57.123817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 911/1819] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:56 2022] DELETE /identity/v3/users/555cd79af1b54595b45cb2aa1cd9f535 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:06:57.125442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2f85-844c-4849-a564-3427f9157999 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:57.125832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2f85-844c-4849-a564-3427f9157999 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:57.126330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb2f85-844c-4849-a564-3427f9157999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:57.139019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 909/1820] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:57 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:57.144116 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442db83c-04cd-406d-9c93-fd4614ace441 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:57.146262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-442db83c-04cd-406d-9c93-fd4614ace441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:57.150245 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-16eb2f85-844c-4849-a564-3427f9157999 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:57.151749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-16eb2f85-844c-4849-a564-3427f9157999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:57.242437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 912/1821] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:57.283750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb2f85-844c-4849-a564-3427f9157999 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:57.287816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-16eb2f85-844c-4849-a564-3427f9157999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:57.316125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442db83c-04cd-406d-9c93-fd4614ace441 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:57.327201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436aea49-f46b-4fef-9985-3a4522893aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:57.327973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436aea49-f46b-4fef-9985-3a4522893aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:57.328264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436aea49-f46b-4fef-9985-3a4522893aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:57.328547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436aea49-f46b-4fef-9985-3a4522893aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:57.329254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436aea49-f46b-4fef-9985-3a4522893aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:57.331246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436aea49-f46b-4fef-9985-3a4522893aa9 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:57.404002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 910/1822] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:57 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:57.410075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436aea49-f46b-4fef-9985-3a4522893aa9 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:57.455426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436aea49-f46b-4fef-9985-3a4522893aa9 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:57.473912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08935ff-7223-4fc7-8282-3c3315469db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:57.476260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08935ff-7223-4fc7-8282-3c3315469db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:57.476260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08935ff-7223-4fc7-8282-3c3315469db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:57.476260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08935ff-7223-4fc7-8282-3c3315469db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:57.476903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08935ff-7223-4fc7-8282-3c3315469db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:57.478912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08935ff-7223-4fc7-8282-3c3315469db9 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:57.494311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 911/1823] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:57.495861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cda75b-b03c-4a87-91e5-59729498eee5 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:57.496152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cda75b-b03c-4a87-91e5-59729498eee5 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:57.496465 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cda75b-b03c-4a87-91e5-59729498eee5 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:57.498119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 912/1824] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 12:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:06:57.498983 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cda75b-b03c-4a87-91e5-59729498eee5 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:57.522980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cda75b-b03c-4a87-91e5-59729498eee5 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:57.540161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83727c67-1f66-4f6d-a587-7a2ba2713f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:57.543727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727c67-1f66-4f6d-a587-7a2ba2713f2d admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:57.545264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727c67-1f66-4f6d-a587-7a2ba2713f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:57.548121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727c67-1f66-4f6d-a587-7a2ba2713f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:57.551339 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83727c67-1f66-4f6d-a587-7a2ba2713f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:57.559996 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83727c67-1f66-4f6d-a587-7a2ba2713f2d admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:57.584396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 913/1825] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:57.588575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83727c67-1f66-4f6d-a587-7a2ba2713f2d admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:57.605553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83727c67-1f66-4f6d-a587-7a2ba2713f2d admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:57.611509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a594d6-7108-4b05-b1f1-a6a75f2a6cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:57.612967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a594d6-7108-4b05-b1f1-a6a75f2a6cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:57.613514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a594d6-7108-4b05-b1f1-a6a75f2a6cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:57.614227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a594d6-7108-4b05-b1f1-a6a75f2a6cbb admin admin] PATH_INFO: `/v3/projects/f8cbe9ba29cb4a24bcbc14f2d508083a/users/ff301306224f4c3b896034284413d0e1/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:57.621752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb2f85-844c-4849-a564-3427f9157999 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:57.626801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc1051-5153-4366-8427-40239e8947f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:57.638852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc1051-5153-4366-8427-40239e8947f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:57.639175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc1051-5153-4366-8427-40239e8947f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:57.639609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc1051-5153-4366-8427-40239e8947f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:57.655320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a594d6-7108-4b05-b1f1-a6a75f2a6cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8cbe9ba29cb4a24bcbc14f2d508083a, user_id=ff301306224f4c3b896034284413d0e1, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:57.661226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc1051-5153-4366-8427-40239e8947f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:57.662483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a594d6-7108-4b05-b1f1-a6a75f2a6cbb admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:57.662706 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc1051-5153-4366-8427-40239e8947f0 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:57.678391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 913/1826] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:57.715206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 914/1827] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:57 2022] PUT /identity/v3/projects/f8cbe9ba29cb4a24bcbc14f2d508083a/users/ff301306224f4c3b896034284413d0e1/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:57.727091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88088-e759-4ca0-a4ba-0c33c904998f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:57.727644 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88088-e759-4ca0-a4ba-0c33c904998f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:57.728083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a88088-e759-4ca0-a4ba-0c33c904998f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:57.753120 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76350bd-77c7-408f-a6c7-5302937db9e4 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:57.754047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76350bd-77c7-408f-a6c7-5302937db9e4 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:57.754703 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76350bd-77c7-408f-a6c7-5302937db9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:57.791162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-d76350bd-77c7-408f-a6c7-5302937db9e4 None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:57.795364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-d76350bd-77c7-408f-a6c7-5302937db9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:57.796453 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-12a88088-e759-4ca0-a4ba-0c33c904998f None None] MFA Rules not processed for user `ff301306224f4c3b896034284413d0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:57.798237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-12a88088-e759-4ca0-a4ba-0c33c904998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:57.907463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 915/1828] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 12:06:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:57.909888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 914/1829] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:57.916299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76350bd-77c7-408f-a6c7-5302937db9e4 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:58.008480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76350bd-77c7-408f-a6c7-5302937db9e4 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:58.015673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5621c2-6742-46fe-ad02-48303573e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:58.016449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5621c2-6742-46fe-ad02-48303573e287 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.017531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5621c2-6742-46fe-ad02-48303573e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.017874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5621c2-6742-46fe-ad02-48303573e287 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:58.018632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5621c2-6742-46fe-ad02-48303573e287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:58.020862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5621c2-6742-46fe-ad02-48303573e287 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:58.056495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a88088-e759-4ca0-a4ba-0c33c904998f None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:58.058187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-12a88088-e759-4ca0-a4ba-0c33c904998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:58.067649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 916/1830] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:06:57 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:06:58.072174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5621c2-6742-46fe-ad02-48303573e287 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:58.084877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a88088-e759-4ca0-a4ba-0c33c904998f None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:58.194827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5621c2-6742-46fe-ad02-48303573e287 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:58.216211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d8dab-e1bd-4c2d-ae62-8c93144e4a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:58.217087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d8dab-e1bd-4c2d-ae62-8c93144e4a44 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.217445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d8dab-e1bd-4c2d-ae62-8c93144e4a44 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.217752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d8dab-e1bd-4c2d-ae62-8c93144e4a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:58.224156 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55513a67-08df-4007-99fc-1accaa3a15bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:58.224884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55513a67-08df-4007-99fc-1accaa3a15bb admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.225163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55513a67-08df-4007-99fc-1accaa3a15bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.225435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55513a67-08df-4007-99fc-1accaa3a15bb admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:58.226140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55513a67-08df-4007-99fc-1accaa3a15bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:58.228689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55513a67-08df-4007-99fc-1accaa3a15bb admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:58.234202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d8dab-e1bd-4c2d-ae62-8c93144e4a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:58.235890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d8dab-e1bd-4c2d-ae62-8c93144e4a44 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:58.248596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 915/1831] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:58.270997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 917/1832] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:06:58 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:06:58.275841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d8dab-e1bd-4c2d-ae62-8c93144e4a44 service nova] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:58.291111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d8dab-e1bd-4c2d-ae62-8c93144e4a44 service nova] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:58.305587 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9b45c-b2f1-4f17-8e1c-81510a4df862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:58.306332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9b45c-b2f1-4f17-8e1c-81510a4df862 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.306617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9b45c-b2f1-4f17-8e1c-81510a4df862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.306952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9b45c-b2f1-4f17-8e1c-81510a4df862 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:58.307705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9b45c-b2f1-4f17-8e1c-81510a4df862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:58.309339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9b45c-b2f1-4f17-8e1c-81510a4df862 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:58.333949 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 916/1833] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:58.338798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55513a67-08df-4007-99fc-1accaa3a15bb admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:58.354297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55513a67-08df-4007-99fc-1accaa3a15bb admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:58.371223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a57c7-2d5a-4aee-9a22-d2450be9a73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:58.374019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a57c7-2d5a-4aee-9a22-d2450be9a73f admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.374371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a57c7-2d5a-4aee-9a22-d2450be9a73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.374681 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a57c7-2d5a-4aee-9a22-d2450be9a73f admin admin] PATH_INFO: `/v3/projects/10475053162b41fc81d65c41a4f29f5e/users/bb8c85a4b28c46d28acab4571698b48e/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:58.412216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a57c7-2d5a-4aee-9a22-d2450be9a73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10475053162b41fc81d65c41a4f29f5e, user_id=bb8c85a4b28c46d28acab4571698b48e, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:58.416223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a57c7-2d5a-4aee-9a22-d2450be9a73f admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:58.436449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 918/1834] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:58 2022] PUT /identity/v3/projects/10475053162b41fc81d65c41a4f29f5e/users/bb8c85a4b28c46d28acab4571698b48e/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:58.441077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9b45c-b2f1-4f17-8e1c-81510a4df862 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:58.455658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9b45c-b2f1-4f17-8e1c-81510a4df862 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:58.537236 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a57c7-2d5a-4aee-9a22-d2450be9a73f admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:58.540415 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5b1a57c7-2d5a-4aee-9a22-d2450be9a73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:58.545898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1cf4-4124-48e4-972d-6efdd1684826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:58.546186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1cf4-4124-48e4-972d-6efdd1684826 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.546437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1cf4-4124-48e4-972d-6efdd1684826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.546728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1cf4-4124-48e4-972d-6efdd1684826 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:58.555121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b1cf4-4124-48e4-972d-6efdd1684826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:58.557631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b1cf4-4124-48e4-972d-6efdd1684826 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:58.577276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 917/1835] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:06:58.577407 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a57c7-2d5a-4aee-9a22-d2450be9a73f admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:58.579041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1cf4-4124-48e4-972d-6efdd1684826 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:58.586863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:58.587752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.588027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.588355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] PATH_INFO: `/v3/projects/f33d9742eb03470e936dcbb02822c30a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:58.590638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33d9742eb03470e936dcbb02822c30a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:58.592786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:58.602392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1cf4-4124-48e4-972d-6efdd1684826 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:58.608393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f42375-10f5-418d-9df6-53466ccc7568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:58.609444 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f42375-10f5-418d-9df6-53466ccc7568 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.609895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f42375-10f5-418d-9df6-53466ccc7568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.610341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f42375-10f5-418d-9df6-53466ccc7568 admin admin] PATH_INFO: `/v3/projects/10475053162b41fc81d65c41a4f29f5e/users/bb8c85a4b28c46d28acab4571698b48e/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:58.612635 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f42375-10f5-418d-9df6-53466ccc7568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10475053162b41fc81d65c41a4f29f5e, user_id=bb8c85a4b28c46d28acab4571698b48e, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:58.615713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f42375-10f5-418d-9df6-53466ccc7568 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:58.630845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 918/1836] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:06:58 2022] PUT /identity/v3/projects/10475053162b41fc81d65c41a4f29f5e/users/bb8c85a4b28c46d28acab4571698b48e/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:58.641981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aaa79-c8c8-4b07-a002-39f1de5d8bec None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.642521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aaa79-c8c8-4b07-a002-39f1de5d8bec None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.643045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aaa79-c8c8-4b07-a002-39f1de5d8bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:58.677381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33d9742eb03470e936dcbb02822c30a', 'request_id': 'req-9f2cdb18-28a3-44c2-946b-a862be709284'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.678934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-bb0aaa79-c8c8-4b07-a002-39f1de5d8bec None None] MFA Rules not processed for user `bb8c85a4b28c46d28acab4571698b48e`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:58.680448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-bb0aaa79-c8c8-4b07-a002-39f1de5d8bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:58.686936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33d9742eb03470e936dcbb02822c30a', 'request_id': 'req-9f2cdb18-28a3-44c2-946b-a862be709284'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.693583 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33d9742eb03470e936dcbb02822c30a', 'request_id': 'req-9f2cdb18-28a3-44c2-946b-a862be709284'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.714306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] The token cache is being invalidate because project f33d9742eb03470e936dcbb02822c30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:06:58.714678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.715549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.720221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 919/1837] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:06:58 2022] DELETE /identity/v3/projects/f33d9742eb03470e936dcbb02822c30a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:06:58.720221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:58.720221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:58.767135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 919/1838] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:06:58.771891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0aaa79-c8c8-4b07-a002-39f1de5d8bec None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:58.771891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-bb0aaa79-c8c8-4b07-a002-39f1de5d8bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:58.795198 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cdb18-28a3-44c2-946b-a862be709284 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:58.818017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:58.818828 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.819368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.819640 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] PATH_INFO: `/v3/users/610fd5f1fefa467c9ff612e0fc789f8a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:58.822237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=610fd5f1fefa467c9ff612e0fc789f8a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:58.825811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:58.852813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0aaa79-c8c8-4b07-a002-39f1de5d8bec None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:58.859283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d24a6-3f39-4aa6-98ca-759ce2d107a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:58.860675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d24a6-3f39-4aa6-98ca-759ce2d107a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.860964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d24a6-3f39-4aa6-98ca-759ce2d107a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.861240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d24a6-3f39-4aa6-98ca-759ce2d107a1 admin admin] PATH_INFO: `/v3/users/7146b7bbe213465cafa30bd6aa6b8798` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:58.862593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d24a6-3f39-4aa6-98ca-759ce2d107a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7146b7bbe213465cafa30bd6aa6b8798)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:58.864866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d24a6-3f39-4aa6-98ca-759ce2d107a1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:58.905180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610fd5f1fefa467c9ff612e0fc789f8a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.906207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610fd5f1fefa467c9ff612e0fc789f8a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.917080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610fd5f1fefa467c9ff612e0fc789f8a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.929395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-930d24a6-3f39-4aa6-98ca-759ce2d107a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7146b7bbe213465cafa30bd6aa6b8798'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.929661 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610fd5f1fefa467c9ff612e0fc789f8a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.931925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610fd5f1fefa467c9ff612e0fc789f8a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.939212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-930d24a6-3f39-4aa6-98ca-759ce2d107a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7146b7bbe213465cafa30bd6aa6b8798'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.948390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-930d24a6-3f39-4aa6-98ca-759ce2d107a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7146b7bbe213465cafa30bd6aa6b8798'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.949015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-930d24a6-3f39-4aa6-98ca-759ce2d107a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7146b7bbe213465cafa30bd6aa6b8798'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.949661 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-930d24a6-3f39-4aa6-98ca-759ce2d107a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7146b7bbe213465cafa30bd6aa6b8798'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:58.952601 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 920/1839] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:58 2022] DELETE /identity/v3/users/610fd5f1fefa467c9ff612e0fc789f8a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:58.953529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:58.954995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:58.980265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 920/1840] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:58 2022] DELETE /identity/v3/users/7146b7bbe213465cafa30bd6aa6b8798 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:58.981415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33049911-e7f2-45d8-84f5-9c37de0762d3 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:58.981705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33049911-e7f2-45d8-84f5-9c37de0762d3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:58.981980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33049911-e7f2-45d8-84f5-9c37de0762d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:59.001250 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-33049911-e7f2-45d8-84f5-9c37de0762d3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:59.002458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-33049911-e7f2-45d8-84f5-9c37de0762d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:59.036798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2bc64-956d-4e60-99c5-0b36bdd31b4b admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:59.111225 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39cb92-59e9-4b06-81eb-d72c93cd8390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:59.113856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39cb92-59e9-4b06-81eb-d72c93cd8390 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:59.114284 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39cb92-59e9-4b06-81eb-d72c93cd8390 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:59.114958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39cb92-59e9-4b06-81eb-d72c93cd8390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:59.119325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 921/1841] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:06:59.119473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-af39cb92-59e9-4b06-81eb-d72c93cd8390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:59.156968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33049911-e7f2-45d8-84f5-9c37de0762d3 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:59.158552 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-33049911-e7f2-45d8-84f5-9c37de0762d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:59.218797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39cb92-59e9-4b06-81eb-d72c93cd8390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:59.220411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39cb92-59e9-4b06-81eb-d72c93cd8390 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:59.244636 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 921/1842] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:59.245637 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33049911-e7f2-45d8-84f5-9c37de0762d3 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:59.249675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2910245-d37c-4300-9b95-17c6f41ff358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:59.250477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2910245-d37c-4300-9b95-17c6f41ff358 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:59.250944 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2910245-d37c-4300-9b95-17c6f41ff358 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:59.261586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2910245-d37c-4300-9b95-17c6f41ff358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:59.286747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2910245-d37c-4300-9b95-17c6f41ff358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:59.289930 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2910245-d37c-4300-9b95-17c6f41ff358 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:59.310961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 922/1843] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:59.380192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39cb92-59e9-4b06-81eb-d72c93cd8390 service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:59.381664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-af39cb92-59e9-4b06-81eb-d72c93cd8390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:59.393404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39cb92-59e9-4b06-81eb-d72c93cd8390 service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:59.398105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965ffc8-3d49-446d-9faa-64a1dfe37b1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:59.399327 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ffc8-3d49-446d-9faa-64a1dfe37b1d service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:59.399616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ffc8-3d49-446d-9faa-64a1dfe37b1d service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:59.399897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965ffc8-3d49-446d-9faa-64a1dfe37b1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:59.401816 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5965ffc8-3d49-446d-9faa-64a1dfe37b1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:59.466566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965ffc8-3d49-446d-9faa-64a1dfe37b1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:59.468072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965ffc8-3d49-446d-9faa-64a1dfe37b1d service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:59.479390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 922/1844] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:06:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:06:59.852756 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2910245-d37c-4300-9b95-17c6f41ff358 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:06:59.854152 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b2910245-d37c-4300-9b95-17c6f41ff358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:06:59.869788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2910245-d37c-4300-9b95-17c6f41ff358 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:06:59.874953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:06:59.875911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:59.876358 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:59.877299 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] PATH_INFO: `/v3/users/ff301306224f4c3b896034284413d0e1` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:59.878521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff301306224f4c3b896034284413d0e1)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:06:59.880499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:06:59.930733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff301306224f4c3b896034284413d0e1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:59.937906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff301306224f4c3b896034284413d0e1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:59.945231 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff301306224f4c3b896034284413d0e1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:59.946775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff301306224f4c3b896034284413d0e1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:59.947394 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff301306224f4c3b896034284413d0e1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:06:59.964698 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 923/1845] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:06:59 2022] DELETE /identity/v3/users/ff301306224f4c3b896034284413d0e1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:06:59.969355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a87d5-ea1f-4b8b-80c8-029e870b4575 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:06:59.969659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a87d5-ea1f-4b8b-80c8-029e870b4575 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:06:59.969945 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a87d5-ea1f-4b8b-80c8-029e870b4575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:06:59.987331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-9b6a87d5-ea1f-4b8b-80c8-029e870b4575 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:06:59.988623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9b6a87d5-ea1f-4b8b-80c8-029e870b4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:00.056719 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 923/1846] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:00.065173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:00.066721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:00.132358 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947cef4-97a6-4b08-ad85-93bf3e0ce3c6 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:00.137133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036a326-c89e-4e17-9e59-892d8bcbc9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:00.138024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036a326-c89e-4e17-9e59-892d8bcbc9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:00.138476 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036a326-c89e-4e17-9e59-892d8bcbc9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:00.139074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036a326-c89e-4e17-9e59-892d8bcbc9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:00.155190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036a326-c89e-4e17-9e59-892d8bcbc9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:00.156434 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036a326-c89e-4e17-9e59-892d8bcbc9a8 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:00.166556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 924/1847] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:00.241055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a87d5-ea1f-4b8b-80c8-029e870b4575 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:00.242409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9b6a87d5-ea1f-4b8b-80c8-029e870b4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:00.254543 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a87d5-ea1f-4b8b-80c8-029e870b4575 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:00.260576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:00.261484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:00.261922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:00.262328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] PATH_INFO: `/v3/projects/1630af89c95f4d219b22b6507835cf24` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:00.265567 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1630af89c95f4d219b22b6507835cf24)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:00.273309 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:00.358616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1630af89c95f4d219b22b6507835cf24', 'request_id': 'req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.377420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1630af89c95f4d219b22b6507835cf24', 'request_id': 'req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.384991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1630af89c95f4d219b22b6507835cf24', 'request_id': 'req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.403192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] The token cache is being invalidate because project 1630af89c95f4d219b22b6507835cf24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:00.404691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.406270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-17b9e7fb-4bcc-4e73-aad8-e4168ad33c9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.409098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 924/1848] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:00 2022] DELETE /identity/v3/projects/1630af89c95f4d219b22b6507835cf24 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:00.416106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27ab5-57ff-462c-8f48-8634d85902fd None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:00.418124 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27ab5-57ff-462c-8f48-8634d85902fd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:00.418639 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d27ab5-57ff-462c-8f48-8634d85902fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:00.455786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-24d27ab5-57ff-462c-8f48-8634d85902fd None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:00.458047 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-24d27ab5-57ff-462c-8f48-8634d85902fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:00.560694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 925/1849] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:00.562657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ec574-afd8-48fb-b380-d37d2b2e39be None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:00.562802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ec574-afd8-48fb-b380-d37d2b2e39be None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:00.563072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ec574-afd8-48fb-b380-d37d2b2e39be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:00.593420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-152ec574-afd8-48fb-b380-d37d2b2e39be None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:00.594681 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-152ec574-afd8-48fb-b380-d37d2b2e39be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:00.615600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 925/1850] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:00.618521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d27ab5-57ff-462c-8f48-8634d85902fd None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:00.630082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d27ab5-57ff-462c-8f48-8634d85902fd None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:00.651253 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ec574-afd8-48fb-b380-d37d2b2e39be None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:00.652895 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-152ec574-afd8-48fb-b380-d37d2b2e39be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:00.661904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68b07-e786-450f-89ca-6437f061b446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:00.664332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68b07-e786-450f-89ca-6437f061b446 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:00.665082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68b07-e786-450f-89ca-6437f061b446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:00.665424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf68b07-e786-450f-89ca-6437f061b446 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:00.666358 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68b07-e786-450f-89ca-6437f061b446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:00.666695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68b07-e786-450f-89ca-6437f061b446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:00.668435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf68b07-e786-450f-89ca-6437f061b446 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:00.674644 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ec574-afd8-48fb-b380-d37d2b2e39be None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:00.682211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:00.683865 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:00.684321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:00.684860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] PATH_INFO: `/v3/projects/14052434a9104a7ba8fba77c6bd40f2f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:00.688905 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14052434a9104a7ba8fba77c6bd40f2f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:00.691794 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:00.710755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 926/1851] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:07:00.710755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68b07-e786-450f-89ca-6437f061b446 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:00.728226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4cf68b07-e786-450f-89ca-6437f061b446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:00.754230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf68b07-e786-450f-89ca-6437f061b446 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:00.766303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:00.768046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:00.768552 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:00.769057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] PATH_INFO: `/v3/projects/f8cbe9ba29cb4a24bcbc14f2d508083a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:00.771972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8cbe9ba29cb4a24bcbc14f2d508083a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:00.775244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:00.787914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14052434a9104a7ba8fba77c6bd40f2f', 'request_id': 'req-e0db90b5-8a95-48ad-be1d-c5125d9678f7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.800431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14052434a9104a7ba8fba77c6bd40f2f', 'request_id': 'req-e0db90b5-8a95-48ad-be1d-c5125d9678f7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.817509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14052434a9104a7ba8fba77c6bd40f2f', 'request_id': 'req-e0db90b5-8a95-48ad-be1d-c5125d9678f7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.835261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8cbe9ba29cb4a24bcbc14f2d508083a', 'request_id': 'req-11c544d2-ffb7-4d35-86f8-f188ad31fa85'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.839317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] The token cache is being invalidate because project 14052434a9104a7ba8fba77c6bd40f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:00.839757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.840504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.842679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 926/1852] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:00 2022] DELETE /identity/v3/projects/14052434a9104a7ba8fba77c6bd40f2f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:07:00.843697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:00.847801 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:00.854533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8cbe9ba29cb4a24bcbc14f2d508083a', 'request_id': 'req-11c544d2-ffb7-4d35-86f8-f188ad31fa85'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.867171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8cbe9ba29cb4a24bcbc14f2d508083a', 'request_id': 'req-11c544d2-ffb7-4d35-86f8-f188ad31fa85'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.885190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] The token cache is being invalidate because project f8cbe9ba29cb4a24bcbc14f2d508083a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:00.885630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.886594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:00.888706 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 927/1853] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:00 2022] DELETE /identity/v3/projects/f8cbe9ba29cb4a24bcbc14f2d508083a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:00.889599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:00.891149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:00.952065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db90b5-8a95-48ad-be1d-c5125d9678f7 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:00.991737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c544d2-ffb7-4d35-86f8-f188ad31fa85 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:01.000095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.001794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.002179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.002540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] PATH_INFO: `/v3/users/a07e5aba0f9644d390445c30cdfdbece` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.004023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07e5aba0f9644d390445c30cdfdbece)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.006538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.033809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d6ad3-d27c-4eb5-9677-7e94e568db4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.034856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d6ad3-d27c-4eb5-9677-7e94e568db4b admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.034856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d6ad3-d27c-4eb5-9677-7e94e568db4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.035241 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d6ad3-d27c-4eb5-9677-7e94e568db4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.036141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d6ad3-d27c-4eb5-9677-7e94e568db4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.038151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d6ad3-d27c-4eb5-9677-7e94e568db4b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.074304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 927/1854] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:00 2022] POST /identity/v3/projects => generated 367 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:01.075215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d6ad3-d27c-4eb5-9677-7e94e568db4b admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:01.077427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ea5d6ad3-d27c-4eb5-9677-7e94e568db4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:01.098867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07e5aba0f9644d390445c30cdfdbece'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.098867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07e5aba0f9644d390445c30cdfdbece'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.105373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07e5aba0f9644d390445c30cdfdbece'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.106036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07e5aba0f9644d390445c30cdfdbece'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.106665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07e5aba0f9644d390445c30cdfdbece'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.124067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 928/1855] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:00 2022] DELETE /identity/v3/users/a07e5aba0f9644d390445c30cdfdbece => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:01.126404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:01.129161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:01.158402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d6ad3-d27c-4eb5-9677-7e94e568db4b admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:01.205466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d7ad9-46f4-430b-811b-0867c22e8a51 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:01.212012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eadd1f-fc8b-4470-9b0b-259c416e7747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.212882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eadd1f-fc8b-4470-9b0b-259c416e7747 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.213068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eadd1f-fc8b-4470-9b0b-259c416e7747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.213332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eadd1f-fc8b-4470-9b0b-259c416e7747 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.214567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eadd1f-fc8b-4470-9b0b-259c416e7747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.216863 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eadd1f-fc8b-4470-9b0b-259c416e7747 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.224952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ba445-48ea-4d70-8593-7a15277c7734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.226324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ba445-48ea-4d70-8593-7a15277c7734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.227495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ba445-48ea-4d70-8593-7a15277c7734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.227840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ba445-48ea-4d70-8593-7a15277c7734 admin admin] PATH_INFO: `/v3/users/bb8c85a4b28c46d28acab4571698b48e` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.229149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ba445-48ea-4d70-8593-7a15277c7734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8c85a4b28c46d28acab4571698b48e)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.231256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ba445-48ea-4d70-8593-7a15277c7734 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.244967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 929/1856] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:01 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:01.249007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eadd1f-fc8b-4470-9b0b-259c416e7747 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:01.261559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eadd1f-fc8b-4470-9b0b-259c416e7747 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:01.267076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bfc5f-2855-4aee-9924-e5a45cd30819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.267812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bfc5f-2855-4aee-9924-e5a45cd30819 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.268106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bfc5f-2855-4aee-9924-e5a45cd30819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.268437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bfc5f-2855-4aee-9924-e5a45cd30819 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.269354 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bfc5f-2855-4aee-9924-e5a45cd30819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.271010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bfc5f-2855-4aee-9924-e5a45cd30819 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.283497 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 930/1857] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:01.287643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bfc5f-2855-4aee-9924-e5a45cd30819 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:01.300138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bfc5f-2855-4aee-9924-e5a45cd30819 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:01.303057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-957ba445-48ea-4d70-8593-7a15277c7734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8c85a4b28c46d28acab4571698b48e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.303738 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-957ba445-48ea-4d70-8593-7a15277c7734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8c85a4b28c46d28acab4571698b48e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.306701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d99d7e-7ffc-4b54-8a9d-609fdd89bd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.307506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d99d7e-7ffc-4b54-8a9d-609fdd89bd53 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.307873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d99d7e-7ffc-4b54-8a9d-609fdd89bd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.308295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d99d7e-7ffc-4b54-8a9d-609fdd89bd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.309152 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d99d7e-7ffc-4b54-8a9d-609fdd89bd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.311037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d99d7e-7ffc-4b54-8a9d-609fdd89bd53 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.312975 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-957ba445-48ea-4d70-8593-7a15277c7734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8c85a4b28c46d28acab4571698b48e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.323596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-957ba445-48ea-4d70-8593-7a15277c7734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8c85a4b28c46d28acab4571698b48e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.324393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-957ba445-48ea-4d70-8593-7a15277c7734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8c85a4b28c46d28acab4571698b48e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.328151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 931/1858] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:07:01.329092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d99d7e-7ffc-4b54-8a9d-609fdd89bd53 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:01.330848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-57d99d7e-7ffc-4b54-8a9d-609fdd89bd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:01.345235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d99d7e-7ffc-4b54-8a9d-609fdd89bd53 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:01.347550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 928/1859] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:01 2022] DELETE /identity/v3/users/bb8c85a4b28c46d28acab4571698b48e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:01.353742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c068299-1fd7-4346-b484-27b772b74d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.354719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c068299-1fd7-4346-b484-27b772b74d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.355076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c068299-1fd7-4346-b484-27b772b74d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.355482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c068299-1fd7-4346-b484-27b772b74d69 admin admin] PATH_INFO: `/v3/projects/b41f1ad82a2b4eddba9f441ada22417d/users/e7291be828684704a461b81e0ab0219c/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.373144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c068299-1fd7-4346-b484-27b772b74d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41f1ad82a2b4eddba9f441ada22417d, user_id=e7291be828684704a461b81e0ab0219c, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.375997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c068299-1fd7-4346-b484-27b772b74d69 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.402489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 932/1860] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:01 2022] PUT /identity/v3/projects/b41f1ad82a2b4eddba9f441ada22417d/users/e7291be828684704a461b81e0ab0219c/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:01.404796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa638dac-7a75-4277-b1f8-1b0b6fe2e893 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.405287 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa638dac-7a75-4277-b1f8-1b0b6fe2e893 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.405379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa638dac-7a75-4277-b1f8-1b0b6fe2e893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.435294 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-aa638dac-7a75-4277-b1f8-1b0b6fe2e893 None None] MFA Rules not processed for user `e7291be828684704a461b81e0ab0219c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:01.436840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-aa638dac-7a75-4277-b1f8-1b0b6fe2e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:01.504828 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 929/1861] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:01.510734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c068299-1fd7-4346-b484-27b772b74d69 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:01.518917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa638dac-7a75-4277-b1f8-1b0b6fe2e893 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:01.520577 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-aa638dac-7a75-4277-b1f8-1b0b6fe2e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:01.613683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa638dac-7a75-4277-b1f8-1b0b6fe2e893 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:01.620841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.622026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.622383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.622663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] PATH_INFO: `/v3/projects/327ba4cca0d74a7c9459985d3be3182e` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.624854 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=327ba4cca0d74a7c9459985d3be3182e)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.626728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c068299-1fd7-4346-b484-27b772b74d69 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:01.626837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.633589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0735d-4971-485f-8477-45c81dc0c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.635059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0735d-4971-485f-8477-45c81dc0c74e admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.635478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0735d-4971-485f-8477-45c81dc0c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.635864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0735d-4971-485f-8477-45c81dc0c74e admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.636808 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0735d-4971-485f-8477-45c81dc0c74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.639148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0735d-4971-485f-8477-45c81dc0c74e admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.674308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 933/1862] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:01 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:01.677858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0735d-4971-485f-8477-45c81dc0c74e admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:01.690312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327ba4cca0d74a7c9459985d3be3182e', 'request_id': 'req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.700854 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327ba4cca0d74a7c9459985d3be3182e', 'request_id': 'req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.710213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327ba4cca0d74a7c9459985d3be3182e', 'request_id': 'req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.742134 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] The token cache is being invalidate because project 327ba4cca0d74a7c9459985d3be3182e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:01.744549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.745765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.750121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 930/1863] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:01 2022] DELETE /identity/v3/projects/327ba4cca0d74a7c9459985d3be3182e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:07:01.755288 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:01.757457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:01.772869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0735d-4971-485f-8477-45c81dc0c74e admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:01.796572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e959b8-be66-41ff-809e-f18d47741966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.797530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e959b8-be66-41ff-809e-f18d47741966 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.798707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e959b8-be66-41ff-809e-f18d47741966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.799159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e959b8-be66-41ff-809e-f18d47741966 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.801735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e959b8-be66-41ff-809e-f18d47741966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.814852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e959b8-be66-41ff-809e-f18d47741966 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.858436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 934/1864] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:01 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:01.862572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e959b8-be66-41ff-809e-f18d47741966 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:01.864432 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-14e959b8-be66-41ff-809e-f18d47741966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:01.878459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e959b8-be66-41ff-809e-f18d47741966 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:01.880036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7cd96-d1e4-4f80-96e2-536f4df1ac56 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:01.885227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.885469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3662da-3b02-43f9-b281-ca04d597f0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:01.886096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.886385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.886718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] PATH_INFO: `/v3/projects/10475053162b41fc81d65c41a4f29f5e` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.887803 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3662da-3b02-43f9-b281-ca04d597f0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:01.887934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10475053162b41fc81d65c41a4f29f5e)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.888728 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3662da-3b02-43f9-b281-ca04d597f0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:01.888728 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3662da-3b02-43f9-b281-ca04d597f0c3 admin admin] PATH_INFO: `/v3/users/33e0604243394749a655aadfdc86d319` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:01.889895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.889997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3662da-3b02-43f9-b281-ca04d597f0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e0604243394749a655aadfdc86d319)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:01.892443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3662da-3b02-43f9-b281-ca04d597f0c3 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:01.953688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10475053162b41fc81d65c41a4f29f5e', 'request_id': 'req-9c58e4e0-33f6-4d1e-971e-954c42784a7e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.964956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10475053162b41fc81d65c41a4f29f5e', 'request_id': 'req-9c58e4e0-33f6-4d1e-971e-954c42784a7e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.967130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aa3662da-3b02-43f9-b281-ca04d597f0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e0604243394749a655aadfdc86d319'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.968042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aa3662da-3b02-43f9-b281-ca04d597f0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e0604243394749a655aadfdc86d319'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.976147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aa3662da-3b02-43f9-b281-ca04d597f0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e0604243394749a655aadfdc86d319'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.978637 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10475053162b41fc81d65c41a4f29f5e', 'request_id': 'req-9c58e4e0-33f6-4d1e-971e-954c42784a7e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.988444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aa3662da-3b02-43f9-b281-ca04d597f0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e0604243394749a655aadfdc86d319'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.989130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aa3662da-3b02-43f9-b281-ca04d597f0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e0604243394749a655aadfdc86d319'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.995380 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] The token cache is being invalidate because project 10475053162b41fc81d65c41a4f29f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:01.995928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:01.998054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:02.000221 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 935/1865] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:01 2022] DELETE /identity/v3/projects/10475053162b41fc81d65c41a4f29f5e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:02.002287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.004933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:02.028481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 931/1866] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:01 2022] DELETE /identity/v3/users/33e0604243394749a655aadfdc86d319 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:02.032392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f963a-34de-4a80-8f13-378660b5955c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.032683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f963a-34de-4a80-8f13-378660b5955c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.032959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f963a-34de-4a80-8f13-378660b5955c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.056097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7f2f963a-34de-4a80-8f13-378660b5955c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:02.058621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7f2f963a-34de-4a80-8f13-378660b5955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:02.129766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58e4e0-33f6-4d1e-971e-954c42784a7e admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.190701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 932/1867] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:02.200660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bdb4e-5213-481c-a4d7-eabb80d68e66 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.200951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bdb4e-5213-481c-a4d7-eabb80d68e66 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.201376 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bdb4e-5213-481c-a4d7-eabb80d68e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.222834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-392bdb4e-5213-481c-a4d7-eabb80d68e66 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:02.224153 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-392bdb4e-5213-481c-a4d7-eabb80d68e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:02.237550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 933/1868] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:02.239087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bdb4e-5213-481c-a4d7-eabb80d68e66 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.240925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a806-850d-4c6c-8ae9-6d5feb0cb4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.241797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a806-850d-4c6c-8ae9-6d5feb0cb4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.242718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a806-850d-4c6c-8ae9-6d5feb0cb4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.243181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a806-850d-4c6c-8ae9-6d5feb0cb4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.244053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a806-850d-4c6c-8ae9-6d5feb0cb4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:02.245824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a806-850d-4c6c-8ae9-6d5feb0cb4f1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:02.250181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bdb4e-5213-481c-a4d7-eabb80d68e66 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.255384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82024b55-5b7b-4cb1-b96e-8fc90261bbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.256062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82024b55-5b7b-4cb1-b96e-8fc90261bbab admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.256549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82024b55-5b7b-4cb1-b96e-8fc90261bbab admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.256831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82024b55-5b7b-4cb1-b96e-8fc90261bbab admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.257574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82024b55-5b7b-4cb1-b96e-8fc90261bbab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:02.257930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82024b55-5b7b-4cb1-b96e-8fc90261bbab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:02.259690 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 936/1869] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:02.260667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82024b55-5b7b-4cb1-b96e-8fc90261bbab admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:02.263251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a806-850d-4c6c-8ae9-6d5feb0cb4f1 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.274781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a806-850d-4c6c-8ae9-6d5feb0cb4f1 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.278771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 934/1870] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:07:02.280101 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82024b55-5b7b-4cb1-b96e-8fc90261bbab admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.290058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8364b12-0bab-4da2-badb-892e2ee603f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.291008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8364b12-0bab-4da2-badb-892e2ee603f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.291364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8364b12-0bab-4da2-badb-892e2ee603f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.291651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8364b12-0bab-4da2-badb-892e2ee603f1 admin admin] PATH_INFO: `/v3/projects/7d743bf838784dccbe995c82cf85d87a/users/26931a777a01400e80180897c27c2c4e/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.296089 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82024b55-5b7b-4cb1-b96e-8fc90261bbab admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.304639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9d485-7942-49c3-9b4c-ccdef2b2869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.307369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9d485-7942-49c3-9b4c-ccdef2b2869f admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.307936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9d485-7942-49c3-9b4c-ccdef2b2869f admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.308379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9d485-7942-49c3-9b4c-ccdef2b2869f admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.309610 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9d485-7942-49c3-9b4c-ccdef2b2869f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:02.310820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8364b12-0bab-4da2-badb-892e2ee603f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d743bf838784dccbe995c82cf85d87a, user_id=26931a777a01400e80180897c27c2c4e, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:02.313311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9d485-7942-49c3-9b4c-ccdef2b2869f admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:02.313819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8364b12-0bab-4da2-badb-892e2ee603f1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:02.353712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 937/1871] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:02 2022] PUT /identity/v3/projects/7d743bf838784dccbe995c82cf85d87a/users/26931a777a01400e80180897c27c2c4e/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:02.357619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8364b12-0bab-4da2-badb-892e2ee603f1 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.359413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 935/1872] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:02 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:02.360288 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9d485-7942-49c3-9b4c-ccdef2b2869f admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.433463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9d485-7942-49c3-9b4c-ccdef2b2869f admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.438790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1db202-6fff-445d-a9ca-904ef32dcbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.439453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1db202-6fff-445d-a9ca-904ef32dcbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.439742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1db202-6fff-445d-a9ca-904ef32dcbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.440022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1db202-6fff-445d-a9ca-904ef32dcbc2 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.440777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1db202-6fff-445d-a9ca-904ef32dcbc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:02.442857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1db202-6fff-445d-a9ca-904ef32dcbc2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:02.447542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8364b12-0bab-4da2-badb-892e2ee603f1 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.452541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169307fc-e5f4-4b79-8174-9014b244c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.453493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169307fc-e5f4-4b79-8174-9014b244c9bf admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.454126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169307fc-e5f4-4b79-8174-9014b244c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.454716 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169307fc-e5f4-4b79-8174-9014b244c9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.455647 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169307fc-e5f4-4b79-8174-9014b244c9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:02.457831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169307fc-e5f4-4b79-8174-9014b244c9bf admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:02.469565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 936/1873] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:02 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:02.473792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1db202-6fff-445d-a9ca-904ef32dcbc2 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.485198 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 938/1874] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:02.488292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169307fc-e5f4-4b79-8174-9014b244c9bf admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.491011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1db202-6fff-445d-a9ca-904ef32dcbc2 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.497841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a878a34-47d6-4538-ae36-e2860f812ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.498808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a878a34-47d6-4538-ae36-e2860f812ceb admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.499196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a878a34-47d6-4538-ae36-e2860f812ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.499575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a878a34-47d6-4538-ae36-e2860f812ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.500529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a878a34-47d6-4538-ae36-e2860f812ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:02.501487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169307fc-e5f4-4b79-8174-9014b244c9bf admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.502821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a878a34-47d6-4538-ae36-e2860f812ceb admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:02.508498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de28b37-990f-4051-81c7-0b2be4428344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.509594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de28b37-990f-4051-81c7-0b2be4428344 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.510017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de28b37-990f-4051-81c7-0b2be4428344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.510430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de28b37-990f-4051-81c7-0b2be4428344 admin admin] PATH_INFO: `/v3/projects/7d743bf838784dccbe995c82cf85d87a/users/26931a777a01400e80180897c27c2c4e/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.512768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de28b37-990f-4051-81c7-0b2be4428344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d743bf838784dccbe995c82cf85d87a, user_id=26931a777a01400e80180897c27c2c4e, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:02.515608 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de28b37-990f-4051-81c7-0b2be4428344 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:02.520214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 937/1875] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:02.529914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a878a34-47d6-4538-ae36-e2860f812ceb admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.547836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 939/1876] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:02 2022] PUT /identity/v3/projects/7d743bf838784dccbe995c82cf85d87a/users/26931a777a01400e80180897c27c2c4e/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:02.560555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b55075-555a-4569-a2ea-f41ed1dbc799 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.561583 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b55075-555a-4569-a2ea-f41ed1dbc799 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.563498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a878a34-47d6-4538-ae36-e2860f812ceb admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.564073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b55075-555a-4569-a2ea-f41ed1dbc799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.609597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-28b55075-555a-4569-a2ea-f41ed1dbc799 None None] MFA Rules not processed for user `26931a777a01400e80180897c27c2c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:02.610931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-28b55075-555a-4569-a2ea-f41ed1dbc799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:02.636657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c3100-e4d7-4444-bb9f-c46a49c90691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.637543 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c3100-e4d7-4444-bb9f-c46a49c90691 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.637967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c3100-e4d7-4444-bb9f-c46a49c90691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.638406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c3100-e4d7-4444-bb9f-c46a49c90691 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.639274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c3100-e4d7-4444-bb9f-c46a49c90691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:02.640897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c3100-e4d7-4444-bb9f-c46a49c90691 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:02.654794 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 938/1877] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:02.656136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c3100-e4d7-4444-bb9f-c46a49c90691 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.670688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c3100-e4d7-4444-bb9f-c46a49c90691 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.682623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9a2ed-14a1-4f1f-b378-64a6b1382b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.683539 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9a2ed-14a1-4f1f-b378-64a6b1382b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.683888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9a2ed-14a1-4f1f-b378-64a6b1382b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.684088 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9a2ed-14a1-4f1f-b378-64a6b1382b35 admin admin] PATH_INFO: `/v3/projects/f7b5dd7714b34e6aa225f91beebd9561/users/73bd6ef13d944bebb98dcfd826392563/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.711895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 940/1878] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:02.715735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9a2ed-14a1-4f1f-b378-64a6b1382b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b5dd7714b34e6aa225f91beebd9561, user_id=73bd6ef13d944bebb98dcfd826392563, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:02.718514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9a2ed-14a1-4f1f-b378-64a6b1382b35 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:02.719027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b55075-555a-4569-a2ea-f41ed1dbc799 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.723360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-28b55075-555a-4569-a2ea-f41ed1dbc799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:02.735739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 939/1879] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:02 2022] PUT /identity/v3/projects/f7b5dd7714b34e6aa225f91beebd9561/users/73bd6ef13d944bebb98dcfd826392563/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:07:02.737380 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9a2ed-14a1-4f1f-b378-64a6b1382b35 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:02.739191 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5cb9a2ed-14a1-4f1f-b378-64a6b1382b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:02.832385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b55075-555a-4569-a2ea-f41ed1dbc799 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.851370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9a2ed-14a1-4f1f-b378-64a6b1382b35 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:02.858309 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.859576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.859723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.860212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] PATH_INFO: `/v3/projects/2d588a5b84874c1692a2a53e35bb551e` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.861546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d588a5b84874c1692a2a53e35bb551e)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:02.863606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:02.909394 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f614ef-9f63-46bb-82b6-891ee887bd13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:02.913943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f614ef-9f63-46bb-82b6-891ee887bd13 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:02.914388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f614ef-9f63-46bb-82b6-891ee887bd13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:02.915533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f614ef-9f63-46bb-82b6-891ee887bd13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:02.988216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d588a5b84874c1692a2a53e35bb551e', 'request_id': 'req-7180d60c-bce3-4d35-bedb-9ddfc81c280a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:02.994134 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d588a5b84874c1692a2a53e35bb551e', 'request_id': 'req-7180d60c-bce3-4d35-bedb-9ddfc81c280a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:03.007738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f614ef-9f63-46bb-82b6-891ee887bd13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:03.009882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f614ef-9f63-46bb-82b6-891ee887bd13 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:03.020092 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d588a5b84874c1692a2a53e35bb551e', 'request_id': 'req-7180d60c-bce3-4d35-bedb-9ddfc81c280a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:03.025593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 941/1880] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:03.028041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c59cc-c2e8-4cde-8da6-6e0e8aa11dcd None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:03.028765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c59cc-c2e8-4cde-8da6-6e0e8aa11dcd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:03.029143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c59cc-c2e8-4cde-8da6-6e0e8aa11dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:03.047027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] The token cache is being invalidate because project 2d588a5b84874c1692a2a53e35bb551e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:03.047423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:03.051739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7180d60c-bce3-4d35-bedb-9ddfc81c280a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:03.053712 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 940/1881] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:02 2022] DELETE /identity/v3/projects/2d588a5b84874c1692a2a53e35bb551e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:03.060984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49b33b-6fbf-4af5-b556-43190a28ffb8 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:03.061722 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49b33b-6fbf-4af5-b556-43190a28ffb8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:03.061722 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49b33b-6fbf-4af5-b556-43190a28ffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:03.068132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-d11c59cc-c2e8-4cde-8da6-6e0e8aa11dcd None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:03.069933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d11c59cc-c2e8-4cde-8da6-6e0e8aa11dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:03.107384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-3a49b33b-6fbf-4af5-b556-43190a28ffb8 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:03.107384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3a49b33b-6fbf-4af5-b556-43190a28ffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:03.291996 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 941/1882] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:03.291996 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49b33b-6fbf-4af5-b556-43190a28ffb8 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:03.291996 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3a49b33b-6fbf-4af5-b556-43190a28ffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:03.310201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 942/1883] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:03.311846 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d6862-87c1-4c4a-83dc-cf3a8b761f96 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:03.314372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d6862-87c1-4c4a-83dc-cf3a8b761f96 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:03.316692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d6862-87c1-4c4a-83dc-cf3a8b761f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:03.377526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-833d6862-87c1-4c4a-83dc-cf3a8b761f96 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:03.378753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-833d6862-87c1-4c4a-83dc-cf3a8b761f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:03.400045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 943/1884] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:03.403383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d6862-87c1-4c4a-83dc-cf3a8b761f96 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:03.403383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-833d6862-87c1-4c4a-83dc-cf3a8b761f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:03.427873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49b33b-6fbf-4af5-b556-43190a28ffb8 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:03.433490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9c418-b608-4bce-8d51-09fac36098f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:03.435354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c418-b608-4bce-8d51-09fac36098f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:03.436104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c418-b608-4bce-8d51-09fac36098f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:03.436506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c418-b608-4bce-8d51-09fac36098f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:03.440584 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-87c9c418-b608-4bce-8d51-09fac36098f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:03.549289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9c418-b608-4bce-8d51-09fac36098f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:03.551163 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9c418-b608-4bce-8d51-09fac36098f0 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:03.572095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 942/1885] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:03.574012 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9c418-b608-4bce-8d51-09fac36098f0 service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:03.589147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9c418-b608-4bce-8d51-09fac36098f0 service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:03.595215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9c138-2668-478f-aa37-6afc3ae33157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:03.596274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c138-2668-478f-aa37-6afc3ae33157 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:03.598793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d6862-87c1-4c4a-83dc-cf3a8b761f96 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:03.604325 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c138-2668-478f-aa37-6afc3ae33157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:03.604742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c138-2668-478f-aa37-6afc3ae33157 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:03.605595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9c138-2668-478f-aa37-6afc3ae33157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:03.605912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9c138-2668-478f-aa37-6afc3ae33157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:03.608450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9c138-2668-478f-aa37-6afc3ae33157 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:03.621173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d7ad0-aa65-476c-b5bd-c84785c88a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:03.621853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d7ad0-aa65-476c-b5bd-c84785c88a05 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:03.622132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d7ad0-aa65-476c-b5bd-c84785c88a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:03.622406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d7ad0-aa65-476c-b5bd-c84785c88a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:03.624396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 943/1886] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:07:03.629265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9c138-2668-478f-aa37-6afc3ae33157 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:03.643293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9c138-2668-478f-aa37-6afc3ae33157 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:03.652288 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d7ad0-aa65-476c-b5bd-c84785c88a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:03.653903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d7ad0-aa65-476c-b5bd-c84785c88a05 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:03.654282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0594254-1188-4d97-b9b3-8bbadf6c4895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:03.655155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0594254-1188-4d97-b9b3-8bbadf6c4895 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:03.656677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0594254-1188-4d97-b9b3-8bbadf6c4895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:03.657878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0594254-1188-4d97-b9b3-8bbadf6c4895 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:03.658706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0594254-1188-4d97-b9b3-8bbadf6c4895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:03.664172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0594254-1188-4d97-b9b3-8bbadf6c4895 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:03.677190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 944/1887] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:03.727144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 944/1888] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:03 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:03.731283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d7ad0-aa65-476c-b5bd-c84785c88a05 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:03.744460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d7ad0-aa65-476c-b5bd-c84785c88a05 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:03.872906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424d5d7-62a7-4865-8e4d-84668741394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:03.873902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424d5d7-62a7-4865-8e4d-84668741394f admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:03.874351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424d5d7-62a7-4865-8e4d-84668741394f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:03.874676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424d5d7-62a7-4865-8e4d-84668741394f admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:03.875926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424d5d7-62a7-4865-8e4d-84668741394f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:03.878261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424d5d7-62a7-4865-8e4d-84668741394f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:03.913217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 945/1889] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:03 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:03.913801 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0594254-1188-4d97-b9b3-8bbadf6c4895 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:03.945608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0594254-1188-4d97-b9b3-8bbadf6c4895 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:03.958617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc921e1a-455e-4fa5-817e-dbb111bc88dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:03.959300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc921e1a-455e-4fa5-817e-dbb111bc88dd admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:03.959580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc921e1a-455e-4fa5-817e-dbb111bc88dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:03.959851 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc921e1a-455e-4fa5-817e-dbb111bc88dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:03.960616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc921e1a-455e-4fa5-817e-dbb111bc88dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:03.962390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc921e1a-455e-4fa5-817e-dbb111bc88dd admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:03.976356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 945/1890] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:07:03.981309 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424d5d7-62a7-4865-8e4d-84668741394f admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:04.008169 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424d5d7-62a7-4865-8e4d-84668741394f admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:04.017560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebb31c-885a-46d7-a1eb-8fccbb750994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:04.018330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb31c-885a-46d7-a1eb-8fccbb750994 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:04.019191 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb31c-885a-46d7-a1eb-8fccbb750994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:04.019545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb31c-885a-46d7-a1eb-8fccbb750994 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:04.029408 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebb31c-885a-46d7-a1eb-8fccbb750994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:04.031430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebb31c-885a-46d7-a1eb-8fccbb750994 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:04.045979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 946/1891] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:04.050633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc921e1a-455e-4fa5-817e-dbb111bc88dd admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:04.066395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc921e1a-455e-4fa5-817e-dbb111bc88dd admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:04.082568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9afc7-69e1-4bdf-8f7e-d3d3ada71034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:04.083499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9afc7-69e1-4bdf-8f7e-d3d3ada71034 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:04.083781 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9afc7-69e1-4bdf-8f7e-d3d3ada71034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:04.084056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9afc7-69e1-4bdf-8f7e-d3d3ada71034 admin admin] PATH_INFO: `/v3/projects/87539fb1027043128f9ca07073c37285/users/9e5d4636a54846078b3ebffbafc100ad/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:04.107341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9afc7-69e1-4bdf-8f7e-d3d3ada71034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87539fb1027043128f9ca07073c37285, user_id=9e5d4636a54846078b3ebffbafc100ad, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:04.110248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9afc7-69e1-4bdf-8f7e-d3d3ada71034 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:04.135219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 946/1892] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:04 2022] PUT /identity/v3/projects/87539fb1027043128f9ca07073c37285/users/9e5d4636a54846078b3ebffbafc100ad/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:07:04.147749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed60a4-bff1-499c-be9c-f850c9dfc828 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:04.148041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed60a4-bff1-499c-be9c-f850c9dfc828 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:04.148345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed60a4-bff1-499c-be9c-f850c9dfc828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:04.191688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-1aed60a4-bff1-499c-be9c-f850c9dfc828 None None] MFA Rules not processed for user `9e5d4636a54846078b3ebffbafc100ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:04.193931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1aed60a4-bff1-499c-be9c-f850c9dfc828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:04.353802 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 947/1893] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:04.364517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9afc7-69e1-4bdf-8f7e-d3d3ada71034 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:04.367752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-76d9afc7-69e1-4bdf-8f7e-d3d3ada71034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:04.435515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9afc7-69e1-4bdf-8f7e-d3d3ada71034 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:04.439007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e7bb7-bde0-4bff-a5c5-450a8f473248 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767fe573dff349918c26995c206f2155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:04.439655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7bb7-bde0-4bff-a5c5-450a8f473248 service glance] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:04.439935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7bb7-bde0-4bff-a5c5-450a8f473248 service glance] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:04.440255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7bb7-bde0-4bff-a5c5-450a8f473248 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:04.449154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e7bb7-bde0-4bff-a5c5-450a8f473248 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:04.450694 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e7bb7-bde0-4bff-a5c5-450a8f473248 service glance] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:04.459687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 947/1894] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:04.646578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99985396-15ed-4a01-8452-088583775d28 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:04.647029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99985396-15ed-4a01-8452-088583775d28 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:04.647446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99985396-15ed-4a01-8452-088583775d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:04.678435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-99985396-15ed-4a01-8452-088583775d28 None None] MFA Rules not processed for user `73bd6ef13d944bebb98dcfd826392563`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:04.680433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-99985396-15ed-4a01-8452-088583775d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:04.777330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 948/1895] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:04.777506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e7bb7-bde0-4bff-a5c5-450a8f473248 service glance] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:04.778718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7b0e7bb7-bde0-4bff-a5c5-450a8f473248 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:04.876745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e7bb7-bde0-4bff-a5c5-450a8f473248 service glance] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:04.881825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10005907-d995-4fe5-86e2-d2c67bb1aff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:04.882524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10005907-d995-4fe5-86e2-d2c67bb1aff7 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:04.883443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10005907-d995-4fe5-86e2-d2c67bb1aff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:04.883725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10005907-d995-4fe5-86e2-d2c67bb1aff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:04.884464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10005907-d995-4fe5-86e2-d2c67bb1aff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:04.886376 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10005907-d995-4fe5-86e2-d2c67bb1aff7 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:04.941127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 948/1896] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:04 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:04.942701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99985396-15ed-4a01-8452-088583775d28 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:04.965356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99985396-15ed-4a01-8452-088583775d28 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:05.027361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28897292-7b8b-4730-ac7b-ce7a76bdac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:05.028049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897292-7b8b-4730-ac7b-ce7a76bdac3c admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:05.028355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897292-7b8b-4730-ac7b-ce7a76bdac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:05.028636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28897292-7b8b-4730-ac7b-ce7a76bdac3c admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:05.029337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28897292-7b8b-4730-ac7b-ce7a76bdac3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:05.031750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28897292-7b8b-4730-ac7b-ce7a76bdac3c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:05.051325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 949/1897] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:04 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:05.055494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10005907-d995-4fe5-86e2-d2c67bb1aff7 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:05.065795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10005907-d995-4fe5-86e2-d2c67bb1aff7 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:05.071133 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c9d28-532f-4311-a925-553404b16616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:05.071800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c9d28-532f-4311-a925-553404b16616 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:05.072086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c9d28-532f-4311-a925-553404b16616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:05.072402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c9d28-532f-4311-a925-553404b16616 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:05.073187 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c9d28-532f-4311-a925-553404b16616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:05.074881 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c9d28-532f-4311-a925-553404b16616 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:05.086565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 949/1898] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:05.091012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28897292-7b8b-4730-ac7b-ce7a76bdac3c admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:05.101065 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28897292-7b8b-4730-ac7b-ce7a76bdac3c admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:05.106942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80707f-de95-4d29-a912-a18e46f05c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:05.107829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80707f-de95-4d29-a912-a18e46f05c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:05.108118 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80707f-de95-4d29-a912-a18e46f05c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:05.108436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80707f-de95-4d29-a912-a18e46f05c4f admin admin] PATH_INFO: `/v3/projects/1e34053582a142e6a305ef3588cc015d/users/225b726913ec473bae3ed1232b811d3f/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:05.123775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80707f-de95-4d29-a912-a18e46f05c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e34053582a142e6a305ef3588cc015d, user_id=225b726913ec473bae3ed1232b811d3f, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:05.126545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80707f-de95-4d29-a912-a18e46f05c4f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:05.139443 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 950/1899] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:05 2022] PUT /identity/v3/projects/1e34053582a142e6a305ef3588cc015d/users/225b726913ec473bae3ed1232b811d3f/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:05.143443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c9d28-532f-4311-a925-553404b16616 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:05.157784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c9d28-532f-4311-a925-553404b16616 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:05.251922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79519747-c380-4a68-8b9b-9badfa4b6bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:05.252644 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79519747-c380-4a68-8b9b-9badfa4b6bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:05.253380 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79519747-c380-4a68-8b9b-9badfa4b6bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:05.253670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79519747-c380-4a68-8b9b-9badfa4b6bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:05.255074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79519747-c380-4a68-8b9b-9badfa4b6bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:05.256817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79519747-c380-4a68-8b9b-9badfa4b6bb9 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:05.274993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 950/1900] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:05.276277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80707f-de95-4d29-a912-a18e46f05c4f admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:05.290654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80707f-de95-4d29-a912-a18e46f05c4f admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:05.297628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27bd4b-a9d7-4839-b990-59b9fa710222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:05.298828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27bd4b-a9d7-4839-b990-59b9fa710222 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:05.299381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27bd4b-a9d7-4839-b990-59b9fa710222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:05.299898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27bd4b-a9d7-4839-b990-59b9fa710222 admin admin] PATH_INFO: `/v3/projects/1e34053582a142e6a305ef3588cc015d/users/225b726913ec473bae3ed1232b811d3f/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:05.302199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27bd4b-a9d7-4839-b990-59b9fa710222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e34053582a142e6a305ef3588cc015d, user_id=225b726913ec473bae3ed1232b811d3f, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:05.305971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27bd4b-a9d7-4839-b990-59b9fa710222 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:05.318890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 951/1901] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:05 2022] PUT /identity/v3/projects/1e34053582a142e6a305ef3588cc015d/users/225b726913ec473bae3ed1232b811d3f/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:06.025181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee21b-2a9f-4d1a-b7e4-2ac1f588d081 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:06.025719 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee21b-2a9f-4d1a-b7e4-2ac1f588d081 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:06.025860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee21b-2a9f-4d1a-b7e4-2ac1f588d081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:06.062237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-0d7ee21b-2a9f-4d1a-b7e4-2ac1f588d081 None None] MFA Rules not processed for user `225b726913ec473bae3ed1232b811d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:06.063491 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0d7ee21b-2a9f-4d1a-b7e4-2ac1f588d081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:06.143737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 951/1902] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:06.155753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27bd4b-a9d7-4839-b990-59b9fa710222 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:06.217748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27bd4b-a9d7-4839-b990-59b9fa710222 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:06.221537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03744f12-7df6-487f-a49c-92a908c5c130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:06.222262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03744f12-7df6-487f-a49c-92a908c5c130 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:06.222614 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03744f12-7df6-487f-a49c-92a908c5c130 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:06.222966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03744f12-7df6-487f-a49c-92a908c5c130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:06.291607 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03744f12-7df6-487f-a49c-92a908c5c130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:06.293079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03744f12-7df6-487f-a49c-92a908c5c130 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:06.304373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 952/1903] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:07.685232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee21b-2a9f-4d1a-b7e4-2ac1f588d081 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:07.686092 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0d7ee21b-2a9f-4d1a-b7e4-2ac1f588d081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:07.702166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee21b-2a9f-4d1a-b7e4-2ac1f588d081 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:07.706458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f2fca-5855-4b86-b788-0b9d62704c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:07.707208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f2fca-5855-4b86-b788-0b9d62704c37 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:07.707518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f2fca-5855-4b86-b788-0b9d62704c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:07.708099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f2fca-5855-4b86-b788-0b9d62704c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:07.725164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f2fca-5855-4b86-b788-0b9d62704c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:07.727719 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f2fca-5855-4b86-b788-0b9d62704c37 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:07.739668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 952/1904] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:09.000644 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03744f12-7df6-487f-a49c-92a908c5c130 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:09.006215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-03744f12-7df6-487f-a49c-92a908c5c130 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:09.070529 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03744f12-7df6-487f-a49c-92a908c5c130 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:09.075595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:09.076492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:09.076778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:09.077047 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] PATH_INFO: `/v3/users/e7291be828684704a461b81e0ab0219c` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:09.078239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7291be828684704a461b81e0ab0219c)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:09.080135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:09.128079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7291be828684704a461b81e0ab0219c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:09.135546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7291be828684704a461b81e0ab0219c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:09.143128 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7291be828684704a461b81e0ab0219c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:09.144008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7291be828684704a461b81e0ab0219c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:09.144822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7291be828684704a461b81e0ab0219c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:09.169414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 953/1905] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:08 2022] DELETE /identity/v3/users/e7291be828684704a461b81e0ab0219c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:09.170696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e948e-7c4c-4674-a094-9e96f53a6156 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:09.171148 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e948e-7c4c-4674-a094-9e96f53a6156 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:09.171253 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e948e-7c4c-4674-a094-9e96f53a6156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:09.242860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2e3e948e-7c4c-4674-a094-9e96f53a6156 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:09.246077 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2e3e948e-7c4c-4674-a094-9e96f53a6156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:09.399393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 953/1906] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:09.481797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:09.484088 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:09.637465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1dcee-4267-4f3d-ba89-db447b96b9d4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:09.652615 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3083f-6ffe-44c9-a936-65fc2f04c82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:09.653385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3083f-6ffe-44c9-a936-65fc2f04c82d service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:09.653758 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3083f-6ffe-44c9-a936-65fc2f04c82d service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:09.654226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3083f-6ffe-44c9-a936-65fc2f04c82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:09.664232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3083f-6ffe-44c9-a936-65fc2f04c82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:09.665784 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3083f-6ffe-44c9-a936-65fc2f04c82d service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:09.678121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 954/1907] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:10.184869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e948e-7c4c-4674-a094-9e96f53a6156 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:10.186296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2e3e948e-7c4c-4674-a094-9e96f53a6156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:10.198519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e948e-7c4c-4674-a094-9e96f53a6156 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:10.203056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:10.203942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:10.204462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:10.204744 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] PATH_INFO: `/v3/projects/b41f1ad82a2b4eddba9f441ada22417d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:10.206030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41f1ad82a2b4eddba9f441ada22417d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:10.207834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:10.267912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41f1ad82a2b4eddba9f441ada22417d', 'request_id': 'req-43f8a850-20cd-450a-b1ee-952c059bddef'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:10.274689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41f1ad82a2b4eddba9f441ada22417d', 'request_id': 'req-43f8a850-20cd-450a-b1ee-952c059bddef'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:10.280406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41f1ad82a2b4eddba9f441ada22417d', 'request_id': 'req-43f8a850-20cd-450a-b1ee-952c059bddef'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:10.293820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] The token cache is being invalidate because project b41f1ad82a2b4eddba9f441ada22417d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:10.294257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:10.294920 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:10.296526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 954/1908] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:10 2022] DELETE /identity/v3/projects/b41f1ad82a2b4eddba9f441ada22417d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:10.300480 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3083f-6ffe-44c9-a936-65fc2f04c82d service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:10.310381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3083f-6ffe-44c9-a936-65fc2f04c82d service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:10.371548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3989ae3-b465-4cd0-971a-4f7cd633658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:10.372457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3989ae3-b465-4cd0-971a-4f7cd633658b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:10.372741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3989ae3-b465-4cd0-971a-4f7cd633658b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:10.373018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3989ae3-b465-4cd0-971a-4f7cd633658b admin admin] PATH_INFO: `/v3/users/26931a777a01400e80180897c27c2c4e` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:10.374472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3989ae3-b465-4cd0-971a-4f7cd633658b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26931a777a01400e80180897c27c2c4e)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:10.376745 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3989ae3-b465-4cd0-971a-4f7cd633658b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:10.425114 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a3989ae3-b465-4cd0-971a-4f7cd633658b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26931a777a01400e80180897c27c2c4e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:10.431827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a3989ae3-b465-4cd0-971a-4f7cd633658b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26931a777a01400e80180897c27c2c4e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:10.439356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a3989ae3-b465-4cd0-971a-4f7cd633658b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26931a777a01400e80180897c27c2c4e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:10.440139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a3989ae3-b465-4cd0-971a-4f7cd633658b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26931a777a01400e80180897c27c2c4e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:10.440763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a3989ae3-b465-4cd0-971a-4f7cd633658b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26931a777a01400e80180897c27c2c4e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:10.460331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 955/1909] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:10 2022] DELETE /identity/v3/users/26931a777a01400e80180897c27c2c4e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:07:11.017497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:11.019179 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:11.039101 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8a850-20cd-450a-b1ee-952c059bddef admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:11.144691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:11.145696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:11.145991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:11.146267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] PATH_INFO: `/v3/projects/7d743bf838784dccbe995c82cf85d87a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:11.147563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d743bf838784dccbe995c82cf85d87a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:11.149606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:11.203299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d743bf838784dccbe995c82cf85d87a', 'request_id': 'req-4a9e29e2-a198-4c3a-b877-928c8a19b54a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:11.215681 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d743bf838784dccbe995c82cf85d87a', 'request_id': 'req-4a9e29e2-a198-4c3a-b877-928c8a19b54a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:11.223316 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d743bf838784dccbe995c82cf85d87a', 'request_id': 'req-4a9e29e2-a198-4c3a-b877-928c8a19b54a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:11.247977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] The token cache is being invalidate because project 7d743bf838784dccbe995c82cf85d87a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:11.248699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:11.249586 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4a9e29e2-a198-4c3a-b877-928c8a19b54a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:11.257362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 955/1910] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:11 2022] DELETE /identity/v3/projects/7d743bf838784dccbe995c82cf85d87a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:11.257747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceb76c-83b3-40ff-a476-06fc5a90961a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:11.258672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceb76c-83b3-40ff-a476-06fc5a90961a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:11.259059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceb76c-83b3-40ff-a476-06fc5a90961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:11.313997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f0ceb76c-83b3-40ff-a476-06fc5a90961a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:11.315424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f0ceb76c-83b3-40ff-a476-06fc5a90961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:11.455308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 956/1911] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:11.464158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d421f-0dce-4a08-b354-7c0c9b35bd89 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:11.464465 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d421f-0dce-4a08-b354-7c0c9b35bd89 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:11.464740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d421f-0dce-4a08-b354-7c0c9b35bd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:11.484131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-b09d421f-0dce-4a08-b354-7c0c9b35bd89 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:11.485426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b09d421f-0dce-4a08-b354-7c0c9b35bd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:11.497017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 956/1912] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:11.498613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ceb76c-83b3-40ff-a476-06fc5a90961a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:11.508591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ceb76c-83b3-40ff-a476-06fc5a90961a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:11.513187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f635a3-dc6b-435a-9e1b-ddd5e39f1723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:11.513940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f635a3-dc6b-435a-9e1b-ddd5e39f1723 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:11.514221 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f635a3-dc6b-435a-9e1b-ddd5e39f1723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:11.514524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f635a3-dc6b-435a-9e1b-ddd5e39f1723 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:11.515247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f635a3-dc6b-435a-9e1b-ddd5e39f1723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:11.515554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f635a3-dc6b-435a-9e1b-ddd5e39f1723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:11.517179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f635a3-dc6b-435a-9e1b-ddd5e39f1723 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:11.534463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 957/1913] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:07:11.535594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d421f-0dce-4a08-b354-7c0c9b35bd89 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:11.546483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d421f-0dce-4a08-b354-7c0c9b35bd89 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:11.552305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eabdb-1556-438e-8b0a-ef4b5df6b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:11.552997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eabdb-1556-438e-8b0a-ef4b5df6b173 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:11.553283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eabdb-1556-438e-8b0a-ef4b5df6b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:11.553558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eabdb-1556-438e-8b0a-ef4b5df6b173 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:11.554261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9eabdb-1556-438e-8b0a-ef4b5df6b173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:11.556429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9eabdb-1556-438e-8b0a-ef4b5df6b173 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:11.587598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 957/1914] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:11 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:11.589726 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f635a3-dc6b-435a-9e1b-ddd5e39f1723 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:11.601675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f635a3-dc6b-435a-9e1b-ddd5e39f1723 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:11.671268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72fedd-c34c-4f80-add4-69accd7ff30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:11.671969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72fedd-c34c-4f80-add4-69accd7ff30a admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:11.672286 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72fedd-c34c-4f80-add4-69accd7ff30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:11.672571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72fedd-c34c-4f80-add4-69accd7ff30a admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:11.673260 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72fedd-c34c-4f80-add4-69accd7ff30a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:11.675180 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72fedd-c34c-4f80-add4-69accd7ff30a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:11.693958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 958/1915] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:11 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:11.698823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eabdb-1556-438e-8b0a-ef4b5df6b173 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:11.709159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eabdb-1556-438e-8b0a-ef4b5df6b173 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:11.714606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886524b4-2db2-4669-86e7-701879448d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:11.715728 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886524b4-2db2-4669-86e7-701879448d83 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:11.716825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886524b4-2db2-4669-86e7-701879448d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:11.717300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886524b4-2db2-4669-86e7-701879448d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:11.718206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886524b4-2db2-4669-86e7-701879448d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:11.720849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886524b4-2db2-4669-86e7-701879448d83 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:11.736560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 958/1916] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:11.737655 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72fedd-c34c-4f80-add4-69accd7ff30a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:11.748869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72fedd-c34c-4f80-add4-69accd7ff30a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:11.753541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd5f89-cf9c-4dfc-b532-4dfb1b9e337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:11.754200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd5f89-cf9c-4dfc-b532-4dfb1b9e337b admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:11.754489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd5f89-cf9c-4dfc-b532-4dfb1b9e337b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:11.754762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd5f89-cf9c-4dfc-b532-4dfb1b9e337b admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:11.755514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd5f89-cf9c-4dfc-b532-4dfb1b9e337b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:11.757147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd5f89-cf9c-4dfc-b532-4dfb1b9e337b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:11.771099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 959/1917] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:11.772043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886524b4-2db2-4669-86e7-701879448d83 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:11.782444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886524b4-2db2-4669-86e7-701879448d83 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:11.787076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332b977-db23-4095-8243-e21543c39072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:11.788037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b977-db23-4095-8243-e21543c39072 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:11.788437 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b977-db23-4095-8243-e21543c39072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:11.788780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332b977-db23-4095-8243-e21543c39072 admin admin] PATH_INFO: `/v3/projects/5c0245f026874434a3732fc81e146c37/users/cb44f409d58e4f9fababbed9231441a3/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:11.805212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332b977-db23-4095-8243-e21543c39072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0245f026874434a3732fc81e146c37, user_id=cb44f409d58e4f9fababbed9231441a3, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:11.808348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332b977-db23-4095-8243-e21543c39072 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:11.826899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 959/1918] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:11 2022] PUT /identity/v3/projects/5c0245f026874434a3732fc81e146c37/users/cb44f409d58e4f9fababbed9231441a3/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:11.837349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504355-06c5-4233-b1ff-dcce162cb945 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:11.837873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504355-06c5-4233-b1ff-dcce162cb945 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:11.838456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504355-06c5-4233-b1ff-dcce162cb945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:11.907259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a4504355-06c5-4233-b1ff-dcce162cb945 None None] MFA Rules not processed for user `cb44f409d58e4f9fababbed9231441a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:11.913544 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a4504355-06c5-4233-b1ff-dcce162cb945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:12.041229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 960/1919] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:12.045965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332b977-db23-4095-8243-e21543c39072 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:12.122875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332b977-db23-4095-8243-e21543c39072 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:12.127559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6897bc-a29d-45f5-8ee5-0367e637ed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:12.128256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6897bc-a29d-45f5-8ee5-0367e637ed62 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:12.128544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6897bc-a29d-45f5-8ee5-0367e637ed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:12.128823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6897bc-a29d-45f5-8ee5-0367e637ed62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:12.129555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6897bc-a29d-45f5-8ee5-0367e637ed62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:12.131465 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6897bc-a29d-45f5-8ee5-0367e637ed62 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:12.160209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 960/1920] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:12 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:12.162940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4504355-06c5-4233-b1ff-dcce162cb945 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:12.173858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4504355-06c5-4233-b1ff-dcce162cb945 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:12.232880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ace5b-116c-4ae5-ac3c-95e66536c2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:12.233560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ace5b-116c-4ae5-ac3c-95e66536c2cd admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:12.233845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ace5b-116c-4ae5-ac3c-95e66536c2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:12.234119 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ace5b-116c-4ae5-ac3c-95e66536c2cd admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:12.234893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ace5b-116c-4ae5-ac3c-95e66536c2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:12.236784 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ace5b-116c-4ae5-ac3c-95e66536c2cd admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:12.258840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 961/1921] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:12 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:12.262915 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6897bc-a29d-45f5-8ee5-0367e637ed62 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:12.274963 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6897bc-a29d-45f5-8ee5-0367e637ed62 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:12.279804 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116d0dc-0603-4d2b-90a7-3e086c06efbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:12.281054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116d0dc-0603-4d2b-90a7-3e086c06efbc admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:12.281336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116d0dc-0603-4d2b-90a7-3e086c06efbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:12.281609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116d0dc-0603-4d2b-90a7-3e086c06efbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:12.282423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116d0dc-0603-4d2b-90a7-3e086c06efbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:12.284409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116d0dc-0603-4d2b-90a7-3e086c06efbc admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:12.297069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 961/1922] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:12.301953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ace5b-116c-4ae5-ac3c-95e66536c2cd admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:12.313310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ace5b-116c-4ae5-ac3c-95e66536c2cd admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:12.318265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cc662-b758-4974-ad4e-4020973ee073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:12.319820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cc662-b758-4974-ad4e-4020973ee073 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:12.320107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cc662-b758-4974-ad4e-4020973ee073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:12.320464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cc662-b758-4974-ad4e-4020973ee073 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:12.321194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cc662-b758-4974-ad4e-4020973ee073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:12.322784 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cc662-b758-4974-ad4e-4020973ee073 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:12.334037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 962/1923] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:12.339830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116d0dc-0603-4d2b-90a7-3e086c06efbc admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:12.354702 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116d0dc-0603-4d2b-90a7-3e086c06efbc admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:12.359947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf91be-92b0-4f8f-a48f-c980a77d241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:12.361023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf91be-92b0-4f8f-a48f-c980a77d241a admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:12.362629 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf91be-92b0-4f8f-a48f-c980a77d241a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:12.363576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf91be-92b0-4f8f-a48f-c980a77d241a admin admin] PATH_INFO: `/v3/projects/3b384af10007441cb6645136d53866f0/users/cc93d58862914588b976409cdafaa55d/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:12.383939 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf91be-92b0-4f8f-a48f-c980a77d241a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b384af10007441cb6645136d53866f0, user_id=cc93d58862914588b976409cdafaa55d, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:12.387207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf91be-92b0-4f8f-a48f-c980a77d241a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:12.405577 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 962/1924] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:12 2022] PUT /identity/v3/projects/3b384af10007441cb6645136d53866f0/users/cc93d58862914588b976409cdafaa55d/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:12.415260 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62f25b-7f34-4215-b2b3-0fef04556111 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:12.415908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62f25b-7f34-4215-b2b3-0fef04556111 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:12.416936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62f25b-7f34-4215-b2b3-0fef04556111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:12.450826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-1b62f25b-7f34-4215-b2b3-0fef04556111 None None] MFA Rules not processed for user `cc93d58862914588b976409cdafaa55d`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:12.452463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1b62f25b-7f34-4215-b2b3-0fef04556111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:12.551977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 963/1925] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:12.557362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf91be-92b0-4f8f-a48f-c980a77d241a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:12.620943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf91be-92b0-4f8f-a48f-c980a77d241a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:12.625650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146dbe7-fc0d-4f66-b014-d5cd28ce00ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:12.626311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146dbe7-fc0d-4f66-b014-d5cd28ce00ba admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:12.626595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146dbe7-fc0d-4f66-b014-d5cd28ce00ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:12.626872 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146dbe7-fc0d-4f66-b014-d5cd28ce00ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:12.627568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146dbe7-fc0d-4f66-b014-d5cd28ce00ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:12.629492 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146dbe7-fc0d-4f66-b014-d5cd28ce00ba admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:12.657455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 963/1926] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:12 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:12.661494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62f25b-7f34-4215-b2b3-0fef04556111 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:12.679087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62f25b-7f34-4215-b2b3-0fef04556111 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:12.758817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecff98-516a-4f2b-997a-9f6f6aaf0281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:12.759501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecff98-516a-4f2b-997a-9f6f6aaf0281 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:12.759785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecff98-516a-4f2b-997a-9f6f6aaf0281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:12.760341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecff98-516a-4f2b-997a-9f6f6aaf0281 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:12.760977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecff98-516a-4f2b-997a-9f6f6aaf0281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:12.762964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecff98-516a-4f2b-997a-9f6f6aaf0281 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:12.784675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 964/1927] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:12 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:12.789233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146dbe7-fc0d-4f66-b014-d5cd28ce00ba admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:12.799141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146dbe7-fc0d-4f66-b014-d5cd28ce00ba admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:12.803952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a56959-8c48-4fd3-b192-99e07e376dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:12.805759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a56959-8c48-4fd3-b192-99e07e376dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:12.806050 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a56959-8c48-4fd3-b192-99e07e376dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:12.806326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a56959-8c48-4fd3-b192-99e07e376dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:12.807053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a56959-8c48-4fd3-b192-99e07e376dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:12.808692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a56959-8c48-4fd3-b192-99e07e376dd7 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:12.819655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 964/1928] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:12.823856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecff98-516a-4f2b-997a-9f6f6aaf0281 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:12.834382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecff98-516a-4f2b-997a-9f6f6aaf0281 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:12.839957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561546e2-b351-444c-aec4-e618347fdce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:12.840893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561546e2-b351-444c-aec4-e618347fdce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:12.841178 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561546e2-b351-444c-aec4-e618347fdce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:12.841454 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561546e2-b351-444c-aec4-e618347fdce1 admin admin] PATH_INFO: `/v3/projects/91725450a1fe41479f77e4932079d3b8/users/9b9cf30bc45a4f9a861909927b97cc6b/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:12.856979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561546e2-b351-444c-aec4-e618347fdce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91725450a1fe41479f77e4932079d3b8, user_id=9b9cf30bc45a4f9a861909927b97cc6b, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:12.859617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561546e2-b351-444c-aec4-e618347fdce1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:12.873842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 965/1929] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:12 2022] PUT /identity/v3/projects/91725450a1fe41479f77e4932079d3b8/users/9b9cf30bc45a4f9a861909927b97cc6b/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:12.878072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a56959-8c48-4fd3-b192-99e07e376dd7 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:12.900131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a56959-8c48-4fd3-b192-99e07e376dd7 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:12.973972 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f809df-3758-4892-b62a-2f3edd64fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:12.974664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f809df-3758-4892-b62a-2f3edd64fbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:12.974948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f809df-3758-4892-b62a-2f3edd64fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:12.975394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f809df-3758-4892-b62a-2f3edd64fbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:12.976217 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f809df-3758-4892-b62a-2f3edd64fbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:12.978216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f809df-3758-4892-b62a-2f3edd64fbe1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:12.989045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 965/1930] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:12.993456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561546e2-b351-444c-aec4-e618347fdce1 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:13.005390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561546e2-b351-444c-aec4-e618347fdce1 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:13.010916 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169498a-664d-469b-ba29-857bd969712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:13.011847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169498a-664d-469b-ba29-857bd969712a admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:13.012130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169498a-664d-469b-ba29-857bd969712a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:13.012477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169498a-664d-469b-ba29-857bd969712a admin admin] PATH_INFO: `/v3/projects/91725450a1fe41479f77e4932079d3b8/users/9b9cf30bc45a4f9a861909927b97cc6b/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:13.014489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169498a-664d-469b-ba29-857bd969712a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91725450a1fe41479f77e4932079d3b8, user_id=9b9cf30bc45a4f9a861909927b97cc6b, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:13.017188 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169498a-664d-469b-ba29-857bd969712a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:13.028268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 966/1931] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:12 2022] PUT /identity/v3/projects/91725450a1fe41479f77e4932079d3b8/users/9b9cf30bc45a4f9a861909927b97cc6b/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:13.038496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20e2e1-a7a6-4a3d-ac9b-f697ffbfba53 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:13.038789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20e2e1-a7a6-4a3d-ac9b-f697ffbfba53 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:13.039272 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20e2e1-a7a6-4a3d-ac9b-f697ffbfba53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:13.068027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ec20e2e1-a7a6-4a3d-ac9b-f697ffbfba53 None None] MFA Rules not processed for user `9b9cf30bc45a4f9a861909927b97cc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:13.069535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ec20e2e1-a7a6-4a3d-ac9b-f697ffbfba53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:13.142628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 966/1932] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:13.162138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169498a-664d-469b-ba29-857bd969712a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:13.164624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4169498a-664d-469b-ba29-857bd969712a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:13.231057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169498a-664d-469b-ba29-857bd969712a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:13.235369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a8e00-ebc2-4aad-b7b6-574d269d5dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:13.236055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a8e00-ebc2-4aad-b7b6-574d269d5dee service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:13.237237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a8e00-ebc2-4aad-b7b6-574d269d5dee service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:13.237237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a8e00-ebc2-4aad-b7b6-574d269d5dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:13.301517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a8e00-ebc2-4aad-b7b6-574d269d5dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:13.303003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a8e00-ebc2-4aad-b7b6-574d269d5dee service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:13.313701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 967/1933] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:14.925104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20e2e1-a7a6-4a3d-ac9b-f697ffbfba53 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:14.934933 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20e2e1-a7a6-4a3d-ac9b-f697ffbfba53 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:14.938372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084ebb5-70bf-4ca0-ab32-b7fd3133fa2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:14.939000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084ebb5-70bf-4ca0-ab32-b7fd3133fa2d service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:14.939291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084ebb5-70bf-4ca0-ab32-b7fd3133fa2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:14.939581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084ebb5-70bf-4ca0-ab32-b7fd3133fa2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:14.994333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084ebb5-70bf-4ca0-ab32-b7fd3133fa2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:14.995771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084ebb5-70bf-4ca0-ab32-b7fd3133fa2d service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:15.004348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 967/1934] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:15.519789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a8e00-ebc2-4aad-b7b6-574d269d5dee service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:15.529414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a8e00-ebc2-4aad-b7b6-574d269d5dee service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:15.537749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962f6dd-7c50-4d77-80ad-55dbbf2de6d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:15.538717 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f6dd-7c50-4d77-80ad-55dbbf2de6d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:15.540707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f6dd-7c50-4d77-80ad-55dbbf2de6d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:15.541045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f6dd-7c50-4d77-80ad-55dbbf2de6d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:15.554694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962f6dd-7c50-4d77-80ad-55dbbf2de6d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:15.556217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962f6dd-7c50-4d77-80ad-55dbbf2de6d9 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:15.565984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 968/1935] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:19.449330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084ebb5-70bf-4ca0-ab32-b7fd3133fa2d service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:19.535293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084ebb5-70bf-4ca0-ab32-b7fd3133fa2d service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:19.551880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:19.553721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:19.554900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:19.556847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] PATH_INFO: `/v3/users/cb44f409d58e4f9fababbed9231441a3` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:19.559530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb44f409d58e4f9fababbed9231441a3)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:19.562174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:19.667430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb44f409d58e4f9fababbed9231441a3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:19.668205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb44f409d58e4f9fababbed9231441a3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:19.676278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb44f409d58e4f9fababbed9231441a3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:19.691844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb44f409d58e4f9fababbed9231441a3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:19.692821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb44f409d58e4f9fababbed9231441a3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:19.720082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 968/1936] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:19 2022] DELETE /identity/v3/users/cb44f409d58e4f9fababbed9231441a3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:19.721748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ca04-ef53-4c2e-8890-8e706d3fb43b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:19.722208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ca04-ef53-4c2e-8890-8e706d3fb43b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:19.722300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ca04-ef53-4c2e-8890-8e706d3fb43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:19.743172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-1418ca04-ef53-4c2e-8890-8e706d3fb43b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:19.744550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1418ca04-ef53-4c2e-8890-8e706d3fb43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:19.876728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 969/1937] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:19.889193 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:19.891298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:19.981160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aba23d-75e8-4e84-8062-8ff654f9ccd1 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:19.985027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de545c4-8acd-4956-80e1-02f8729410a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:19.985759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de545c4-8acd-4956-80e1-02f8729410a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:19.986132 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de545c4-8acd-4956-80e1-02f8729410a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:19.986474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de545c4-8acd-4956-80e1-02f8729410a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:20.000997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de545c4-8acd-4956-80e1-02f8729410a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:20.002574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de545c4-8acd-4956-80e1-02f8729410a2 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:20.013767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 969/1938] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:20.299603 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418ca04-ef53-4c2e-8890-8e706d3fb43b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:20.301479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1418ca04-ef53-4c2e-8890-8e706d3fb43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:20.313199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418ca04-ef53-4c2e-8890-8e706d3fb43b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:20.318786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:20.320014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:20.320430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:20.320963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] PATH_INFO: `/v3/projects/5c0245f026874434a3732fc81e146c37` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:20.322286 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0245f026874434a3732fc81e146c37)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:20.324575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:20.379415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0245f026874434a3732fc81e146c37', 'request_id': 'req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:20.386822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0245f026874434a3732fc81e146c37', 'request_id': 'req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:20.393012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0245f026874434a3732fc81e146c37', 'request_id': 'req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:20.403738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] The token cache is being invalidate because project 5c0245f026874434a3732fc81e146c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:20.404027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:20.404701 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:20.406275 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 970/1939] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:20 2022] DELETE /identity/v3/projects/5c0245f026874434a3732fc81e146c37 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:20.410201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de545c4-8acd-4956-80e1-02f8729410a2 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:20.419616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de545c4-8acd-4956-80e1-02f8729410a2 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:20.476238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:20.477017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:20.477305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:20.477589 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] PATH_INFO: `/v3/users/cc93d58862914588b976409cdafaa55d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:20.478784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc93d58862914588b976409cdafaa55d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:20.480808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:20.532396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc93d58862914588b976409cdafaa55d'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:20.533096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc93d58862914588b976409cdafaa55d'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:20.540655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc93d58862914588b976409cdafaa55d'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:20.549916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc93d58862914588b976409cdafaa55d'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:20.550742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc93d58862914588b976409cdafaa55d'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:20.567476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 970/1940] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:20 2022] DELETE /identity/v3/users/cc93d58862914588b976409cdafaa55d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:07:20.875215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:20.877515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:20.900262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbcee0-3888-4dcb-ac10-5d57ec4f8bcc admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:20.983672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:20.984730 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:20.985024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:20.985303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] PATH_INFO: `/v3/projects/3b384af10007441cb6645136d53866f0` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:20.993844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b384af10007441cb6645136d53866f0)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:20.996071 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:21.091381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b384af10007441cb6645136d53866f0', 'request_id': 'req-09ad8605-bfce-43c1-afba-3deb4e80a232'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.120917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b384af10007441cb6645136d53866f0', 'request_id': 'req-09ad8605-bfce-43c1-afba-3deb4e80a232'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.137376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b384af10007441cb6645136d53866f0', 'request_id': 'req-09ad8605-bfce-43c1-afba-3deb4e80a232'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.151728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] The token cache is being invalidate because project 3b384af10007441cb6645136d53866f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:21.152165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.153014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.155021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 971/1941] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:20 2022] DELETE /identity/v3/projects/3b384af10007441cb6645136d53866f0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:21.158768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:21.160228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:21.178263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f08781-cd17-4c23-9930-2045ce787911 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:21.262282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff04e2-c7a1-421c-8c74-5db9a0c48174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:21.263322 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff04e2-c7a1-421c-8c74-5db9a0c48174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:21.263604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff04e2-c7a1-421c-8c74-5db9a0c48174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:21.263883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff04e2-c7a1-421c-8c74-5db9a0c48174 admin admin] PATH_INFO: `/v3/users/9b9cf30bc45a4f9a861909927b97cc6b` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:21.265251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff04e2-c7a1-421c-8c74-5db9a0c48174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9cf30bc45a4f9a861909927b97cc6b)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:21.267608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff04e2-c7a1-421c-8c74-5db9a0c48174 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:21.342283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4aff04e2-c7a1-421c-8c74-5db9a0c48174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9cf30bc45a4f9a861909927b97cc6b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.342912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4aff04e2-c7a1-421c-8c74-5db9a0c48174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9cf30bc45a4f9a861909927b97cc6b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.350451 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4aff04e2-c7a1-421c-8c74-5db9a0c48174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9cf30bc45a4f9a861909927b97cc6b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.359148 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4aff04e2-c7a1-421c-8c74-5db9a0c48174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9cf30bc45a4f9a861909927b97cc6b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.359897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4aff04e2-c7a1-421c-8c74-5db9a0c48174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9cf30bc45a4f9a861909927b97cc6b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.383589 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 971/1942] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:21 2022] DELETE /identity/v3/users/9b9cf30bc45a4f9a861909927b97cc6b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:21.748702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:21.750239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:21.780699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad8605-bfce-43c1-afba-3deb4e80a232 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:21.842364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:21.843240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:21.843521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:21.843837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] PATH_INFO: `/v3/projects/91725450a1fe41479f77e4932079d3b8` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:21.845038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91725450a1fe41479f77e4932079d3b8)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:21.846951 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:21.896037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91725450a1fe41479f77e4932079d3b8', 'request_id': 'req-918deb12-9af2-409e-ad30-acf6273c3d39'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.904695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91725450a1fe41479f77e4932079d3b8', 'request_id': 'req-918deb12-9af2-409e-ad30-acf6273c3d39'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.911632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91725450a1fe41479f77e4932079d3b8', 'request_id': 'req-918deb12-9af2-409e-ad30-acf6273c3d39'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.925327 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] The token cache is being invalidate because project 91725450a1fe41479f77e4932079d3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:21.925747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.927077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-918deb12-9af2-409e-ad30-acf6273c3d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:21.930956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 972/1943] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:21 2022] DELETE /identity/v3/projects/91725450a1fe41479f77e4932079d3b8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:21.937869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5691b9-6f2d-45a6-b242-f1e4c43b0a02 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:21.938368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5691b9-6f2d-45a6-b242-f1e4c43b0a02 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:21.939738 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5691b9-6f2d-45a6-b242-f1e4c43b0a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:21.961404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ff5691b9-6f2d-45a6-b242-f1e4c43b0a02 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:21.962594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ff5691b9-6f2d-45a6-b242-f1e4c43b0a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:22.032444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 972/1944] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:22.037799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa42ad-0dcb-4a5e-8551-c4dcafcd4cf7 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:22.038172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa42ad-0dcb-4a5e-8551-c4dcafcd4cf7 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:22.038527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa42ad-0dcb-4a5e-8551-c4dcafcd4cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:22.061716 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-82fa42ad-0dcb-4a5e-8551-c4dcafcd4cf7 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:22.063117 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-82fa42ad-0dcb-4a5e-8551-c4dcafcd4cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:22.081252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 973/1945] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:22.085999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5691b9-6f2d-45a6-b242-f1e4c43b0a02 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:22.096035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5691b9-6f2d-45a6-b242-f1e4c43b0a02 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:22.102473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388503e6-7e39-4490-bcc8-df0cc43b3f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:22.103224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388503e6-7e39-4490-bcc8-df0cc43b3f3b admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:22.103703 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388503e6-7e39-4490-bcc8-df0cc43b3f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:22.104196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388503e6-7e39-4490-bcc8-df0cc43b3f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:22.105128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388503e6-7e39-4490-bcc8-df0cc43b3f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:22.105621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388503e6-7e39-4490-bcc8-df0cc43b3f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:22.107523 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388503e6-7e39-4490-bcc8-df0cc43b3f3b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:22.123072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 973/1946] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:07:22.127224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa42ad-0dcb-4a5e-8551-c4dcafcd4cf7 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:22.140130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa42ad-0dcb-4a5e-8551-c4dcafcd4cf7 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:22.146191 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d47be8-6f2e-4596-ac5e-345ac2fa68e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:22.146889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d47be8-6f2e-4596-ac5e-345ac2fa68e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:22.147173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d47be8-6f2e-4596-ac5e-345ac2fa68e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:22.147450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d47be8-6f2e-4596-ac5e-345ac2fa68e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:22.148238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d47be8-6f2e-4596-ac5e-345ac2fa68e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:22.151079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d47be8-6f2e-4596-ac5e-345ac2fa68e7 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:22.197586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 974/1947] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:22 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:22.201374 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388503e6-7e39-4490-bcc8-df0cc43b3f3b admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:22.213693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388503e6-7e39-4490-bcc8-df0cc43b3f3b admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:22.286406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd00108-278a-4474-be55-8ff8570fdffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:22.287097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd00108-278a-4474-be55-8ff8570fdffc admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:22.287382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd00108-278a-4474-be55-8ff8570fdffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:22.287661 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd00108-278a-4474-be55-8ff8570fdffc admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:22.288415 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd00108-278a-4474-be55-8ff8570fdffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:22.290752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd00108-278a-4474-be55-8ff8570fdffc admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:22.325145 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 974/1948] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:22 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:22.330115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d47be8-6f2e-4596-ac5e-345ac2fa68e7 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:22.343660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d47be8-6f2e-4596-ac5e-345ac2fa68e7 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:22.351093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f384338-7b95-4cc3-9b11-e3658a081629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:22.351851 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f384338-7b95-4cc3-9b11-e3658a081629 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:22.352136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f384338-7b95-4cc3-9b11-e3658a081629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:22.352455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f384338-7b95-4cc3-9b11-e3658a081629 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:22.353240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f384338-7b95-4cc3-9b11-e3658a081629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:22.354907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f384338-7b95-4cc3-9b11-e3658a081629 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:22.373001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 975/1949] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:07:22.373841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd00108-278a-4474-be55-8ff8570fdffc admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:22.400763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd00108-278a-4474-be55-8ff8570fdffc admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:22.416827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90892f-2573-46ca-b218-bd93faec40c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:22.419416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90892f-2573-46ca-b218-bd93faec40c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:22.420464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90892f-2573-46ca-b218-bd93faec40c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:22.421531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90892f-2573-46ca-b218-bd93faec40c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:22.423018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90892f-2573-46ca-b218-bd93faec40c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:22.439493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90892f-2573-46ca-b218-bd93faec40c6 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:22.468611 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 975/1950] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:07:22.472697 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f384338-7b95-4cc3-9b11-e3658a081629 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:22.484367 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f384338-7b95-4cc3-9b11-e3658a081629 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:22.514543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa104c25-f6fb-4cf8-bb7e-1dbbacbfafe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:22.517823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa104c25-f6fb-4cf8-bb7e-1dbbacbfafe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:22.520113 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa104c25-f6fb-4cf8-bb7e-1dbbacbfafe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:22.521636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa104c25-f6fb-4cf8-bb7e-1dbbacbfafe3 admin admin] PATH_INFO: `/v3/projects/d2b6122241c04fd59e645625065de32b/users/02b79df3f8cd495b8e1c6f68cd17ace3/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:22.561440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa104c25-f6fb-4cf8-bb7e-1dbbacbfafe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b6122241c04fd59e645625065de32b, user_id=02b79df3f8cd495b8e1c6f68cd17ace3, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:22.564142 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa104c25-f6fb-4cf8-bb7e-1dbbacbfafe3 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:22.587112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 976/1951] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:22 2022] PUT /identity/v3/projects/d2b6122241c04fd59e645625065de32b/users/02b79df3f8cd495b8e1c6f68cd17ace3/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:22.598395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3d862-a14d-4b50-96e4-d2b7078bdd7b None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:22.598515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3d862-a14d-4b50-96e4-d2b7078bdd7b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:22.598873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3d862-a14d-4b50-96e4-d2b7078bdd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:22.629801 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ade3d862-a14d-4b50-96e4-d2b7078bdd7b None None] MFA Rules not processed for user `02b79df3f8cd495b8e1c6f68cd17ace3`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:22.631551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ade3d862-a14d-4b50-96e4-d2b7078bdd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:22.641950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa104c25-f6fb-4cf8-bb7e-1dbbacbfafe3 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:22.643749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-aa104c25-f6fb-4cf8-bb7e-1dbbacbfafe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:22.719443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 976/1952] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:22.733121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3d862-a14d-4b50-96e4-d2b7078bdd7b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:22.734430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa104c25-f6fb-4cf8-bb7e-1dbbacbfafe3 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:22.735295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ade3d862-a14d-4b50-96e4-d2b7078bdd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:22.739893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:22.740971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:22.741269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:22.741643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] PATH_INFO: `/v3/users/73bd6ef13d944bebb98dcfd826392563` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:22.743146 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73bd6ef13d944bebb98dcfd826392563)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:22.745954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:22.803911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73bd6ef13d944bebb98dcfd826392563'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:22.804108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3d862-a14d-4b50-96e4-d2b7078bdd7b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:22.808434 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78411665-8824-44ec-aecc-69f0a0847e68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:22.809096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78411665-8824-44ec-aecc-69f0a0847e68 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:22.809384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78411665-8824-44ec-aecc-69f0a0847e68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:22.809664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78411665-8824-44ec-aecc-69f0a0847e68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:22.812541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73bd6ef13d944bebb98dcfd826392563'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:22.818536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78411665-8824-44ec-aecc-69f0a0847e68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:22.821242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78411665-8824-44ec-aecc-69f0a0847e68 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:22.822737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73bd6ef13d944bebb98dcfd826392563'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:22.823467 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73bd6ef13d944bebb98dcfd826392563'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:22.824173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73bd6ef13d944bebb98dcfd826392563'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:22.833573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 977/1953] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:07:22.842812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 977/1954] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:22 2022] DELETE /identity/v3/users/73bd6ef13d944bebb98dcfd826392563 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:07:23.047732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78411665-8824-44ec-aecc-69f0a0847e68 service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:23.062777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78411665-8824-44ec-aecc-69f0a0847e68 service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:23.144669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:23.160639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:23.161679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:23.162297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] PATH_INFO: `/v3/projects/f7b5dd7714b34e6aa225f91beebd9561` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:23.164921 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b5dd7714b34e6aa225f91beebd9561)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:23.167867 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:23.248299 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b5dd7714b34e6aa225f91beebd9561', 'request_id': 'req-8c2adc1b-05a5-4888-b928-2d83ac520d04'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.258684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b5dd7714b34e6aa225f91beebd9561', 'request_id': 'req-8c2adc1b-05a5-4888-b928-2d83ac520d04'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.265283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b5dd7714b34e6aa225f91beebd9561', 'request_id': 'req-8c2adc1b-05a5-4888-b928-2d83ac520d04'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.278249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] The token cache is being invalidate because project f7b5dd7714b34e6aa225f91beebd9561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:23.278555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.279172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.280816 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 978/1955] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:23 2022] DELETE /identity/v3/projects/f7b5dd7714b34e6aa225f91beebd9561 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:23.284879 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:23.286456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:23.306002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cd6fa-ba6c-4376-829b-edf944aa4d45 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:23.365859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd273882-3ef2-4018-9daa-ac953316532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:23.366753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd273882-3ef2-4018-9daa-ac953316532c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:23.367766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd273882-3ef2-4018-9daa-ac953316532c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:23.368081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd273882-3ef2-4018-9daa-ac953316532c admin admin] PATH_INFO: `/v3/users/225b726913ec473bae3ed1232b811d3f` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:23.370203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd273882-3ef2-4018-9daa-ac953316532c admin admin] RBAC: Authorizing `identity:delete_user(user_id=225b726913ec473bae3ed1232b811d3f)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:23.372267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd273882-3ef2-4018-9daa-ac953316532c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:23.425269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fd273882-3ef2-4018-9daa-ac953316532c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225b726913ec473bae3ed1232b811d3f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.434647 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fd273882-3ef2-4018-9daa-ac953316532c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225b726913ec473bae3ed1232b811d3f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.442577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fd273882-3ef2-4018-9daa-ac953316532c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225b726913ec473bae3ed1232b811d3f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.443440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fd273882-3ef2-4018-9daa-ac953316532c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225b726913ec473bae3ed1232b811d3f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.444099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fd273882-3ef2-4018-9daa-ac953316532c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225b726913ec473bae3ed1232b811d3f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.467019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 978/1956] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:23 2022] DELETE /identity/v3/users/225b726913ec473bae3ed1232b811d3f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:23.673486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:23.674954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:23.688909 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2adc1b-05a5-4888-b928-2d83ac520d04 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:23.756962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:23.758508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:23.758877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:23.759053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] PATH_INFO: `/v3/projects/1e34053582a142e6a305ef3588cc015d` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:23.760428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e34053582a142e6a305ef3588cc015d)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:23.762519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:23.816823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e34053582a142e6a305ef3588cc015d', 'request_id': 'req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.824385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e34053582a142e6a305ef3588cc015d', 'request_id': 'req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.830057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e34053582a142e6a305ef3588cc015d', 'request_id': 'req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.845842 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] The token cache is being invalidate because project 1e34053582a142e6a305ef3588cc015d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:23.846241 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.846971 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3f0a3824-d1bb-4d58-8c27-e44e95926a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:23.848763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 979/1957] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:23 2022] DELETE /identity/v3/projects/1e34053582a142e6a305ef3588cc015d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:07:23.854885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78586-1ed0-4dd4-8d81-d70fda7acf92 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:23.855180 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78586-1ed0-4dd4-8d81-d70fda7acf92 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:23.855460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78586-1ed0-4dd4-8d81-d70fda7acf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:23.875059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a8a78586-1ed0-4dd4-8d81-d70fda7acf92 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:23.876480 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a8a78586-1ed0-4dd4-8d81-d70fda7acf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:23.943754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 979/1958] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:23.951815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dfeee-b10f-40b3-97cd-ede244a05d3f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:23.952106 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dfeee-b10f-40b3-97cd-ede244a05d3f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:23.952443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dfeee-b10f-40b3-97cd-ede244a05d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:23.973255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1c4dfeee-b10f-40b3-97cd-ede244a05d3f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:23.974505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1c4dfeee-b10f-40b3-97cd-ede244a05d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:23.987328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 980/1959] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:23.988967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a78586-1ed0-4dd4-8d81-d70fda7acf92 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.000257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a78586-1ed0-4dd4-8d81-d70fda7acf92 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:24.005158 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548c7dd-ffab-4d43-8d87-9eed12ea327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:24.006895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c7dd-ffab-4d43-8d87-9eed12ea327b admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.006895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c7dd-ffab-4d43-8d87-9eed12ea327b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.006895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c7dd-ffab-4d43-8d87-9eed12ea327b admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.007154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548c7dd-ffab-4d43-8d87-9eed12ea327b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:24.008355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548c7dd-ffab-4d43-8d87-9eed12ea327b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:24.009091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548c7dd-ffab-4d43-8d87-9eed12ea327b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:24.020960 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 980/1960] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:07:24.026034 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dfeee-b10f-40b3-97cd-ede244a05d3f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.035550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dfeee-b10f-40b3-97cd-ede244a05d3f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:24.041422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e743636-b48a-4ebd-9fa8-8e5f59c93d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:24.042303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e743636-b48a-4ebd-9fa8-8e5f59c93d3e admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.042761 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e743636-b48a-4ebd-9fa8-8e5f59c93d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.043255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e743636-b48a-4ebd-9fa8-8e5f59c93d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.044142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e743636-b48a-4ebd-9fa8-8e5f59c93d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:24.046486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e743636-b48a-4ebd-9fa8-8e5f59c93d3e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:24.079452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 981/1961] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:24 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:24.082027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548c7dd-ffab-4d43-8d87-9eed12ea327b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.093613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548c7dd-ffab-4d43-8d87-9eed12ea327b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:24.160865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5386-403b-4425-86c6-a309ae4b4e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:24.161844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5386-403b-4425-86c6-a309ae4b4e17 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.162136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5386-403b-4425-86c6-a309ae4b4e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.162414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd5386-403b-4425-86c6-a309ae4b4e17 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.163175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd5386-403b-4425-86c6-a309ae4b4e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:24.166791 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd5386-403b-4425-86c6-a309ae4b4e17 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:24.194734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 981/1962] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:24 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:24.196676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e743636-b48a-4ebd-9fa8-8e5f59c93d3e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.210344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e743636-b48a-4ebd-9fa8-8e5f59c93d3e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:24.216834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108481d8-278d-40f0-81b0-76f62e9943be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:24.217770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108481d8-278d-40f0-81b0-76f62e9943be admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.218683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108481d8-278d-40f0-81b0-76f62e9943be admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.218683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108481d8-278d-40f0-81b0-76f62e9943be admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.219477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108481d8-278d-40f0-81b0-76f62e9943be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:24.221268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108481d8-278d-40f0-81b0-76f62e9943be admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:24.236041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 982/1963] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:24.240239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5386-403b-4425-86c6-a309ae4b4e17 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.251230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd5386-403b-4425-86c6-a309ae4b4e17 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:24.256619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76383bd4-a62a-4a04-8b34-cec2be68e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:24.257306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76383bd4-a62a-4a04-8b34-cec2be68e4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.258107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76383bd4-a62a-4a04-8b34-cec2be68e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.258379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76383bd4-a62a-4a04-8b34-cec2be68e4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.259269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76383bd4-a62a-4a04-8b34-cec2be68e4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:24.260929 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76383bd4-a62a-4a04-8b34-cec2be68e4f6 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:24.281271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 982/1964] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:24.285450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108481d8-278d-40f0-81b0-76f62e9943be admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.301320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108481d8-278d-40f0-81b0-76f62e9943be admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:24.310770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd711dba-152c-417c-9207-b3b36b895e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:24.311818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711dba-152c-417c-9207-b3b36b895e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.312002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711dba-152c-417c-9207-b3b36b895e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.316524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711dba-152c-417c-9207-b3b36b895e76 admin admin] PATH_INFO: `/v3/projects/4c4caedce53046b3ac3f6d08ef718606/users/738da53efbd34b91a7093a86c8d5aaa4/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.340442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd711dba-152c-417c-9207-b3b36b895e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4caedce53046b3ac3f6d08ef718606, user_id=738da53efbd34b91a7093a86c8d5aaa4, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:24.343387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd711dba-152c-417c-9207-b3b36b895e76 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:24.375013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 983/1965] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:24 2022] PUT /identity/v3/projects/4c4caedce53046b3ac3f6d08ef718606/users/738da53efbd34b91a7093a86c8d5aaa4/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:24.376969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d7d78-4f89-443f-bbce-d47a29cc1e3d None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.377507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d7d78-4f89-443f-bbce-d47a29cc1e3d None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.377507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d7d78-4f89-443f-bbce-d47a29cc1e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.424822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-1d7d7d78-4f89-443f-bbce-d47a29cc1e3d None None] MFA Rules not processed for user `738da53efbd34b91a7093a86c8d5aaa4`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:24.426554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1d7d7d78-4f89-443f-bbce-d47a29cc1e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:24.509017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 983/1966] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:24.513592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd711dba-152c-417c-9207-b3b36b895e76 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.588114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd711dba-152c-417c-9207-b3b36b895e76 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:24.594397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc0920-1ae8-4b30-b57a-4d5a8c9132fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:24.595152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc0920-1ae8-4b30-b57a-4d5a8c9132fc admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.595511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc0920-1ae8-4b30-b57a-4d5a8c9132fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.596302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc0920-1ae8-4b30-b57a-4d5a8c9132fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.596856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc0920-1ae8-4b30-b57a-4d5a8c9132fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:24.599473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbc0920-1ae8-4b30-b57a-4d5a8c9132fc admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:24.638407 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 984/1967] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:24 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:24.640008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d7d78-4f89-443f-bbce-d47a29cc1e3d None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.661642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d7d78-4f89-443f-bbce-d47a29cc1e3d None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:24.737941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9dd60-12a0-4062-9e92-eb6ebfefdc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:24.739027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9dd60-12a0-4062-9e92-eb6ebfefdc22 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.739424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9dd60-12a0-4062-9e92-eb6ebfefdc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.739861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9dd60-12a0-4062-9e92-eb6ebfefdc22 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.741187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9dd60-12a0-4062-9e92-eb6ebfefdc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:24.744952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9dd60-12a0-4062-9e92-eb6ebfefdc22 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:24.778113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc0920-1ae8-4b30-b57a-4d5a8c9132fc admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.786172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 984/1968] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:24 2022] POST /identity/v3/users => generated 298 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:24.791921 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc0920-1ae8-4b30-b57a-4d5a8c9132fc admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:24.798838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d307c6-cf62-4b19-a45e-db4604bc2575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:24.800427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d307c6-cf62-4b19-a45e-db4604bc2575 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.800731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d307c6-cf62-4b19-a45e-db4604bc2575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.801006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d307c6-cf62-4b19-a45e-db4604bc2575 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.801753 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d307c6-cf62-4b19-a45e-db4604bc2575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:24.803566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d307c6-cf62-4b19-a45e-db4604bc2575 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:24.818111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 985/1969] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:24.823265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9dd60-12a0-4062-9e92-eb6ebfefdc22 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.834335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9dd60-12a0-4062-9e92-eb6ebfefdc22 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:24.840590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53b2f8-d6e8-4210-98f8-4c025b5556a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:24.841775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53b2f8-d6e8-4210-98f8-4c025b5556a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.841775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53b2f8-d6e8-4210-98f8-4c025b5556a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.842041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53b2f8-d6e8-4210-98f8-4c025b5556a5 admin admin] PATH_INFO: `/v3/projects/00793ecd38e343999d952e8993485a83/users/42694d3b8b60423e87833d18bed9b81c/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.861112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53b2f8-d6e8-4210-98f8-4c025b5556a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00793ecd38e343999d952e8993485a83, user_id=42694d3b8b60423e87833d18bed9b81c, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:24.865203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53b2f8-d6e8-4210-98f8-4c025b5556a5 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:24.881306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 985/1970] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:24 2022] PUT /identity/v3/projects/00793ecd38e343999d952e8993485a83/users/42694d3b8b60423e87833d18bed9b81c/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:24.886261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d307c6-cf62-4b19-a45e-db4604bc2575 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.896825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d307c6-cf62-4b19-a45e-db4604bc2575 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:24.961340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06a08f-29be-4f7f-8b28-9fb22987fe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:24.962335 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a08f-29be-4f7f-8b28-9fb22987fe6c admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:24.963159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a08f-29be-4f7f-8b28-9fb22987fe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:24.963441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a08f-29be-4f7f-8b28-9fb22987fe6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:24.964276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06a08f-29be-4f7f-8b28-9fb22987fe6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:24.966411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06a08f-29be-4f7f-8b28-9fb22987fe6c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:24.980418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 986/1971] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:24.981796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53b2f8-d6e8-4210-98f8-4c025b5556a5 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:24.993269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53b2f8-d6e8-4210-98f8-4c025b5556a5 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:25.001764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e40349-3a41-4f36-aeea-dc738c8dbd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:25.002620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40349-3a41-4f36-aeea-dc738c8dbd86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:25.002958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40349-3a41-4f36-aeea-dc738c8dbd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:25.003349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e40349-3a41-4f36-aeea-dc738c8dbd86 admin admin] PATH_INFO: `/v3/projects/00793ecd38e343999d952e8993485a83/users/42694d3b8b60423e87833d18bed9b81c/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:25.005571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e40349-3a41-4f36-aeea-dc738c8dbd86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00793ecd38e343999d952e8993485a83, user_id=42694d3b8b60423e87833d18bed9b81c, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:25.008804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e40349-3a41-4f36-aeea-dc738c8dbd86 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:25.019895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 986/1972] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:24 2022] PUT /identity/v3/projects/00793ecd38e343999d952e8993485a83/users/42694d3b8b60423e87833d18bed9b81c/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:25.031822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d788f-bc50-4bdb-b87d-0a8f2f29c992 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:25.032119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d788f-bc50-4bdb-b87d-0a8f2f29c992 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:25.032449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d788f-bc50-4bdb-b87d-0a8f2f29c992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:25.065511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-8d8d788f-bc50-4bdb-b87d-0a8f2f29c992 None None] MFA Rules not processed for user `42694d3b8b60423e87833d18bed9b81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:25.067130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-8d8d788f-bc50-4bdb-b87d-0a8f2f29c992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:25.154212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 987/1973] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:25.166325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e40349-3a41-4f36-aeea-dc738c8dbd86 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:25.169739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-83e40349-3a41-4f36-aeea-dc738c8dbd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:25.263227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e40349-3a41-4f36-aeea-dc738c8dbd86 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:25.267395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c36699-1294-4611-a2cd-6033f24836e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:25.268265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c36699-1294-4611-a2cd-6033f24836e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:25.268557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c36699-1294-4611-a2cd-6033f24836e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:25.268837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c36699-1294-4611-a2cd-6033f24836e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:25.359515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c36699-1294-4611-a2cd-6033f24836e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:25.364827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c36699-1294-4611-a2cd-6033f24836e9 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:25.404134 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 987/1974] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:32.082870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d788f-bc50-4bdb-b87d-0a8f2f29c992 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:32.093182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d788f-bc50-4bdb-b87d-0a8f2f29c992 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:32.096918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b047db-f4be-49f8-9e9a-3eddd8525e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:32.097637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b047db-f4be-49f8-9e9a-3eddd8525e18 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:32.097988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b047db-f4be-49f8-9e9a-3eddd8525e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:32.098381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b047db-f4be-49f8-9e9a-3eddd8525e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:32.109119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b047db-f4be-49f8-9e9a-3eddd8525e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:32.110701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b047db-f4be-49f8-9e9a-3eddd8525e18 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:32.121264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 988/1975] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:07:34.811068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c36699-1294-4611-a2cd-6033f24836e9 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:34.813246 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-10c36699-1294-4611-a2cd-6033f24836e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:34.886799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c36699-1294-4611-a2cd-6033f24836e9 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:34.891394 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:34.892294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:34.892579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:34.892860 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] PATH_INFO: `/v3/users/2c48fb9b327045ed9236bea1ef6cdd73` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:34.894062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c48fb9b327045ed9236bea1ef6cdd73)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:34.895970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:34.942630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c48fb9b327045ed9236bea1ef6cdd73'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:34.950512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c48fb9b327045ed9236bea1ef6cdd73'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:34.960030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c48fb9b327045ed9236bea1ef6cdd73'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:34.961246 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c48fb9b327045ed9236bea1ef6cdd73'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:34.961931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c48fb9b327045ed9236bea1ef6cdd73'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:34.979576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 988/1976] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:34 2022] DELETE /identity/v3/users/2c48fb9b327045ed9236bea1ef6cdd73 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:35.141580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b047db-f4be-49f8-9e9a-3eddd8525e18 service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:35.143431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-56b047db-f4be-49f8-9e9a-3eddd8525e18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:35.153140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:35.154676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:35.157593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b047db-f4be-49f8-9e9a-3eddd8525e18 service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:35.221737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0155041-7127-4489-b226-aa46c824cd37 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:35.226307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:35.227398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.227530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de9a6d-b0e4-446b-8565-6a4928a2c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:35.227679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.228107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] PATH_INFO: `/v3/projects/672159344e2c4ecbb0b633aa9606a119` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.228395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de9a6d-b0e4-446b-8565-6a4928a2c1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.228704 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de9a6d-b0e4-446b-8565-6a4928a2c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.228948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de9a6d-b0e4-446b-8565-6a4928a2c1c3 admin admin] PATH_INFO: `/v3/users/9e5d4636a54846078b3ebffbafc100ad` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.229323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=672159344e2c4ecbb0b633aa9606a119)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:35.230183 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de9a6d-b0e4-446b-8565-6a4928a2c1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5d4636a54846078b3ebffbafc100ad)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:35.231203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:35.232100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de9a6d-b0e4-446b-8565-6a4928a2c1c3 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:35.278437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672159344e2c4ecbb0b633aa9606a119', 'request_id': 'req-c3bb7398-20b5-4159-9cf7-10eeec4575f1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.285597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672159344e2c4ecbb0b633aa9606a119', 'request_id': 'req-c3bb7398-20b5-4159-9cf7-10eeec4575f1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.287399 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-01de9a6d-b0e4-446b-8565-6a4928a2c1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5d4636a54846078b3ebffbafc100ad'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.288047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-01de9a6d-b0e4-446b-8565-6a4928a2c1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5d4636a54846078b3ebffbafc100ad'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.291981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672159344e2c4ecbb0b633aa9606a119', 'request_id': 'req-c3bb7398-20b5-4159-9cf7-10eeec4575f1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.295114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-01de9a6d-b0e4-446b-8565-6a4928a2c1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5d4636a54846078b3ebffbafc100ad'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.302346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-01de9a6d-b0e4-446b-8565-6a4928a2c1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5d4636a54846078b3ebffbafc100ad'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.302624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] The token cache is being invalidate because project 672159344e2c4ecbb0b633aa9606a119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:35.302826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.303122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-01de9a6d-b0e4-446b-8565-6a4928a2c1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5d4636a54846078b3ebffbafc100ad'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.303474 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c3bb7398-20b5-4159-9cf7-10eeec4575f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.305797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 989/1977] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:35 2022] DELETE /identity/v3/projects/672159344e2c4ecbb0b633aa9606a119 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:35.310537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10de26-80ff-477f-b335-406df211db05 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.310826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10de26-80ff-477f-b335-406df211db05 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.311101 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10de26-80ff-477f-b335-406df211db05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.322073 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 989/1978] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:35 2022] DELETE /identity/v3/users/9e5d4636a54846078b3ebffbafc100ad => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:35.326363 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8be2ec-fc57-4ef9-b6ef-a97984beb0d3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.326692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8be2ec-fc57-4ef9-b6ef-a97984beb0d3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.326980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8be2ec-fc57-4ef9-b6ef-a97984beb0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.329950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-1d10de26-80ff-477f-b335-406df211db05 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:35.331076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1d10de26-80ff-477f-b335-406df211db05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:35.344027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7c8be2ec-fc57-4ef9-b6ef-a97984beb0d3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:35.345254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7c8be2ec-fc57-4ef9-b6ef-a97984beb0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:35.389864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 990/1979] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:35.397138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9052a6-e70f-427f-bb63-979ca6d25db9 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.397532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9052a6-e70f-427f-bb63-979ca6d25db9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.397869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9052a6-e70f-427f-bb63-979ca6d25db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.406235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 990/1980] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:35.416069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-6e9052a6-e70f-427f-bb63-979ca6d25db9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:35.416662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8be2ec-fc57-4ef9-b6ef-a97984beb0d3 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:35.417277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6e9052a6-e70f-427f-bb63-979ca6d25db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:35.418060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7c8be2ec-fc57-4ef9-b6ef-a97984beb0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:35.425139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 991/1981] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:35.429264 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9052a6-e70f-427f-bb63-979ca6d25db9 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:35.438372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9052a6-e70f-427f-bb63-979ca6d25db9 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:35.443119 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2248071-b5c6-4e58-a295-e26c224e2434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:35.443778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2248071-b5c6-4e58-a295-e26c224e2434 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.444065 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2248071-b5c6-4e58-a295-e26c224e2434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.445208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2248071-b5c6-4e58-a295-e26c224e2434 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.446077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2248071-b5c6-4e58-a295-e26c224e2434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:35.446385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2248071-b5c6-4e58-a295-e26c224e2434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:35.447983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2248071-b5c6-4e58-a295-e26c224e2434 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:35.459605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 992/1982] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:07:35.464081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2248071-b5c6-4e58-a295-e26c224e2434 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:35.473355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2248071-b5c6-4e58-a295-e26c224e2434 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:35.474242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8be2ec-fc57-4ef9-b6ef-a97984beb0d3 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:35.478490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848b95-245a-4510-a2af-09dfcd7c9241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:35.478641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c00a33-10f1-45dd-81ba-7875eb1efe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:35.479129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c00a33-10f1-45dd-81ba-7875eb1efe18 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.479228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848b95-245a-4510-a2af-09dfcd7c9241 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.479412 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c00a33-10f1-45dd-81ba-7875eb1efe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.479525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848b95-245a-4510-a2af-09dfcd7c9241 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.479683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c00a33-10f1-45dd-81ba-7875eb1efe18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.479772 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3848b95-245a-4510-a2af-09dfcd7c9241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.480393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c00a33-10f1-45dd-81ba-7875eb1efe18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:35.482262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c00a33-10f1-45dd-81ba-7875eb1efe18 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:35.488641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3848b95-245a-4510-a2af-09dfcd7c9241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:35.490078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3848b95-245a-4510-a2af-09dfcd7c9241 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:35.499985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 991/1983] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:07:35.511287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 993/1984] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:35 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:35.512463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848b95-245a-4510-a2af-09dfcd7c9241 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:35.523090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3848b95-245a-4510-a2af-09dfcd7c9241 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:35.584580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeda42b-b0cd-48d1-9484-fa0be8da8fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:35.585259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeda42b-b0cd-48d1-9484-fa0be8da8fbd admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.585683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeda42b-b0cd-48d1-9484-fa0be8da8fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.585960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeda42b-b0cd-48d1-9484-fa0be8da8fbd admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.586650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeda42b-b0cd-48d1-9484-fa0be8da8fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:35.588619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeda42b-b0cd-48d1-9484-fa0be8da8fbd admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:35.609262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 992/1985] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:35 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:35.613066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c00a33-10f1-45dd-81ba-7875eb1efe18 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:35.623695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c00a33-10f1-45dd-81ba-7875eb1efe18 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:35.628578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241723a5-14bb-46fd-a9a1-78fd305617db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:35.629259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241723a5-14bb-46fd-a9a1-78fd305617db admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.629523 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241723a5-14bb-46fd-a9a1-78fd305617db admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.629819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241723a5-14bb-46fd-a9a1-78fd305617db admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.630537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241723a5-14bb-46fd-a9a1-78fd305617db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:35.632122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241723a5-14bb-46fd-a9a1-78fd305617db admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:35.642866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 994/1986] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:35.646908 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeda42b-b0cd-48d1-9484-fa0be8da8fbd admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:35.658502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeda42b-b0cd-48d1-9484-fa0be8da8fbd admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:35.664107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53476e2-f6a9-41f5-9a27-307074e5baf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:35.664805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53476e2-f6a9-41f5-9a27-307074e5baf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.665119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53476e2-f6a9-41f5-9a27-307074e5baf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.665398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53476e2-f6a9-41f5-9a27-307074e5baf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.666126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53476e2-f6a9-41f5-9a27-307074e5baf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:35.667729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53476e2-f6a9-41f5-9a27-307074e5baf3 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:35.677880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 993/1987] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:35.682243 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241723a5-14bb-46fd-a9a1-78fd305617db admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:35.692077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241723a5-14bb-46fd-a9a1-78fd305617db admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:35.697552 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb07cf-030f-4d20-810d-ea0a1e973ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:35.698424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb07cf-030f-4d20-810d-ea0a1e973ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.698700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb07cf-030f-4d20-810d-ea0a1e973ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.698991 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb07cf-030f-4d20-810d-ea0a1e973ebf admin admin] PATH_INFO: `/v3/projects/995ad3f94a194c30a86a9c2b5b11935f/users/79c9c9de0b974e2997c296d9fb555249/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.714690 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb07cf-030f-4d20-810d-ea0a1e973ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=995ad3f94a194c30a86a9c2b5b11935f, user_id=79c9c9de0b974e2997c296d9fb555249, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:35.717495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb07cf-030f-4d20-810d-ea0a1e973ebf admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:35.731213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 995/1988] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:35 2022] PUT /identity/v3/projects/995ad3f94a194c30a86a9c2b5b11935f/users/79c9c9de0b974e2997c296d9fb555249/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:35.741361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d62cd-82c2-4387-b2d9-5e1f0f01fcc2 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.742208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d62cd-82c2-4387-b2d9-5e1f0f01fcc2 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.742554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d62cd-82c2-4387-b2d9-5e1f0f01fcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.783451 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-9b6d62cd-82c2-4387-b2d9-5e1f0f01fcc2 None None] MFA Rules not processed for user `79c9c9de0b974e2997c296d9fb555249`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:35.784831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9b6d62cd-82c2-4387-b2d9-5e1f0f01fcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:35.790192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb07cf-030f-4d20-810d-ea0a1e973ebf admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:35.793399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-3aeb07cf-030f-4d20-810d-ea0a1e973ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:35.863604 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb07cf-030f-4d20-810d-ea0a1e973ebf admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:35.864619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 994/1989] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:35.871361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:35.872248 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.872534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.872815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] PATH_INFO: `/v3/projects/87539fb1027043128f9ca07073c37285` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.874010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87539fb1027043128f9ca07073c37285)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:35.875997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:35.876392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d62cd-82c2-4387-b2d9-5e1f0f01fcc2 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:35.877717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9b6d62cd-82c2-4387-b2d9-5e1f0f01fcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:35.923623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87539fb1027043128f9ca07073c37285', 'request_id': 'req-6a92feb9-df51-463f-baef-661d81d4de71'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.932433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87539fb1027043128f9ca07073c37285', 'request_id': 'req-6a92feb9-df51-463f-baef-661d81d4de71'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.938821 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87539fb1027043128f9ca07073c37285', 'request_id': 'req-6a92feb9-df51-463f-baef-661d81d4de71'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.950099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] The token cache is being invalidate because project 87539fb1027043128f9ca07073c37285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:35.950391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.951084 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6a92feb9-df51-463f-baef-661d81d4de71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:35.951683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d62cd-82c2-4387-b2d9-5e1f0f01fcc2 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:35.953349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 996/1990] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:35 2022] DELETE /identity/v3/projects/87539fb1027043128f9ca07073c37285 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:35.957978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741693-1996-45cd-8441-65cf799726d4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:35.958348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741693-1996-45cd-8441-65cf799726d4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:35.958634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741693-1996-45cd-8441-65cf799726d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:35.976499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-17741693-1996-45cd-8441-65cf799726d4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:35.977605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-17741693-1996-45cd-8441-65cf799726d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:36.016845 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41145292-42e4-435b-b6d4-781159e29609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:36.017531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41145292-42e4-435b-b6d4-781159e29609 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.017813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41145292-42e4-435b-b6d4-781159e29609 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.018086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41145292-42e4-435b-b6d4-781159e29609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.019920 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-41145292-42e4-435b-b6d4-781159e29609 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:36.045199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 997/1991] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:36.046928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af8a2-e661-4435-a51b-9451bcb12b62 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.047281 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af8a2-e661-4435-a51b-9451bcb12b62 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.047623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af8a2-e661-4435-a51b-9451bcb12b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.066012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ff4af8a2-e661-4435-a51b-9451bcb12b62 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:36.067304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ff4af8a2-e661-4435-a51b-9451bcb12b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:36.076507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 998/1992] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:36.080697 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4af8a2-e661-4435-a51b-9451bcb12b62 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:36.089241 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41145292-42e4-435b-b6d4-781159e29609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:36.090279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4af8a2-e661-4435-a51b-9451bcb12b62 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:36.090835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41145292-42e4-435b-b6d4-781159e29609 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:36.095140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba8cfc-af87-42c6-b652-68c4b1ae0286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:36.095869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8cfc-af87-42c6-b652-68c4b1ae0286 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.096248 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8cfc-af87-42c6-b652-68c4b1ae0286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.096594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8cfc-af87-42c6-b652-68c4b1ae0286 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.097422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba8cfc-af87-42c6-b652-68c4b1ae0286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:36.097806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba8cfc-af87-42c6-b652-68c4b1ae0286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:36.099453 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba8cfc-af87-42c6-b652-68c4b1ae0286 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:36.099987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 995/1993] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:36.112464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 999/1994] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:07:36.122428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41145292-42e4-435b-b6d4-781159e29609 service nova] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:36.136888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41145292-42e4-435b-b6d4-781159e29609 service nova] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:36.139870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4629615-2a35-423b-a84c-35b7800e68f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:36.140643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629615-2a35-423b-a84c-35b7800e68f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.141143 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629615-2a35-423b-a84c-35b7800e68f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.141454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629615-2a35-423b-a84c-35b7800e68f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.142264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4629615-2a35-423b-a84c-35b7800e68f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:36.144158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4629615-2a35-423b-a84c-35b7800e68f3 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:36.176835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 996/1995] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:36 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:36.181463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba8cfc-af87-42c6-b652-68c4b1ae0286 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:36.191622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba8cfc-af87-42c6-b652-68c4b1ae0286 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:36.264405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca778ad4-1d92-40e7-bb24-0bb5a54a5e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:36.265096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca778ad4-1d92-40e7-bb24-0bb5a54a5e47 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.265409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca778ad4-1d92-40e7-bb24-0bb5a54a5e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.265687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca778ad4-1d92-40e7-bb24-0bb5a54a5e47 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.266384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca778ad4-1d92-40e7-bb24-0bb5a54a5e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:36.268483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca778ad4-1d92-40e7-bb24-0bb5a54a5e47 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:36.292621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1000/1996] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:36 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:36.297281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4629615-2a35-423b-a84c-35b7800e68f3 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:36.309240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4629615-2a35-423b-a84c-35b7800e68f3 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:36.310548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca778ad4-1d92-40e7-bb24-0bb5a54a5e47 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:36.312306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ca778ad4-1d92-40e7-bb24-0bb5a54a5e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:36.314737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59855d-fb9e-41e3-999e-0e4e4f554c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:36.315436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59855d-fb9e-41e3-999e-0e4e4f554c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.315722 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59855d-fb9e-41e3-999e-0e4e4f554c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.316002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59855d-fb9e-41e3-999e-0e4e4f554c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.316793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59855d-fb9e-41e3-999e-0e4e4f554c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:36.318389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59855d-fb9e-41e3-999e-0e4e4f554c2f admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:36.324840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca778ad4-1d92-40e7-bb24-0bb5a54a5e47 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:36.329549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f4684-1106-480f-a26f-9a3ed35f6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:36.329731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 997/1997] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:36.330456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f4684-1106-480f-a26f-9a3ed35f6370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.330727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f4684-1106-480f-a26f-9a3ed35f6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.331004 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f4684-1106-480f-a26f-9a3ed35f6370 admin admin] PATH_INFO: `/v3/users/79c9c9de0b974e2997c296d9fb555249` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.332232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f4684-1106-480f-a26f-9a3ed35f6370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c9c9de0b974e2997c296d9fb555249)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:36.333654 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59855d-fb9e-41e3-999e-0e4e4f554c2f admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:36.334423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f4684-1106-480f-a26f-9a3ed35f6370 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:36.343602 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59855d-fb9e-41e3-999e-0e4e4f554c2f admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:36.349261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40c801-6758-49f8-95eb-d2fd3213e59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:36.349913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40c801-6758-49f8-95eb-d2fd3213e59e admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.350199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40c801-6758-49f8-95eb-d2fd3213e59e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.350478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40c801-6758-49f8-95eb-d2fd3213e59e admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.352004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40c801-6758-49f8-95eb-d2fd3213e59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:36.353656 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40c801-6758-49f8-95eb-d2fd3213e59e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:36.364781 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 998/1998] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:07:36.369704 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40c801-6758-49f8-95eb-d2fd3213e59e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:36.379206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40c801-6758-49f8-95eb-d2fd3213e59e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:36.383677 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7f5f4684-1106-480f-a26f-9a3ed35f6370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c9c9de0b974e2997c296d9fb555249'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:36.384540 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bcd6e-41b8-48e7-88df-2ed5df2a1866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:36.385406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bcd6e-41b8-48e7-88df-2ed5df2a1866 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.385690 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bcd6e-41b8-48e7-88df-2ed5df2a1866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.385968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bcd6e-41b8-48e7-88df-2ed5df2a1866 admin admin] PATH_INFO: `/v3/projects/97a5c28bb5be4d43a607ebf906c1a67c/users/46438fbece5b49f484cc4ae71a817bad/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.390443 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7f5f4684-1106-480f-a26f-9a3ed35f6370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c9c9de0b974e2997c296d9fb555249'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:36.397853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7f5f4684-1106-480f-a26f-9a3ed35f6370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c9c9de0b974e2997c296d9fb555249'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:36.399204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7f5f4684-1106-480f-a26f-9a3ed35f6370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c9c9de0b974e2997c296d9fb555249'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:36.399838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7f5f4684-1106-480f-a26f-9a3ed35f6370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c9c9de0b974e2997c296d9fb555249'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:36.401442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bcd6e-41b8-48e7-88df-2ed5df2a1866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a5c28bb5be4d43a607ebf906c1a67c, user_id=46438fbece5b49f484cc4ae71a817bad, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:36.404094 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bcd6e-41b8-48e7-88df-2ed5df2a1866 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:36.416852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 999/1999] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:36 2022] PUT /identity/v3/projects/97a5c28bb5be4d43a607ebf906c1a67c/users/46438fbece5b49f484cc4ae71a817bad/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:07:36.417849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1001/2000] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:36 2022] DELETE /identity/v3/users/79c9c9de0b974e2997c296d9fb555249 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:36.425688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9939d7-436b-4064-a5b0-a777217dcd3f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.426036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9939d7-436b-4064-a5b0-a777217dcd3f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.426320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9939d7-436b-4064-a5b0-a777217dcd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.427794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad74da2-83a5-4d12-8b71-15cf4eda80e3 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.428087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad74da2-83a5-4d12-8b71-15cf4eda80e3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.428401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad74da2-83a5-4d12-8b71-15cf4eda80e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.445596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7d9939d7-436b-4064-a5b0-a777217dcd3f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:36.446796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7d9939d7-436b-4064-a5b0-a777217dcd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:36.456636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-8ad74da2-83a5-4d12-8b71-15cf4eda80e3 None None] MFA Rules not processed for user `46438fbece5b49f484cc4ae71a817bad`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:36.457794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-8ad74da2-83a5-4d12-8b71-15cf4eda80e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:36.504514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1000/2001] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:36.515002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9939d7-436b-4064-a5b0-a777217dcd3f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:36.516390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7d9939d7-436b-4064-a5b0-a777217dcd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:36.521305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1002/2002] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:36.535799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad74da2-83a5-4d12-8b71-15cf4eda80e3 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:36.537569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-8ad74da2-83a5-4d12-8b71-15cf4eda80e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:36.574748 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9939d7-436b-4064-a5b0-a777217dcd3f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:36.578468 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c12ba9-007e-483d-9875-26e99a45c453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:36.579109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12ba9-007e-483d-9875-26e99a45c453 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.579388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12ba9-007e-483d-9875-26e99a45c453 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.579662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12ba9-007e-483d-9875-26e99a45c453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.588712 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c12ba9-007e-483d-9875-26e99a45c453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:36.590148 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c12ba9-007e-483d-9875-26e99a45c453 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:36.596314 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad74da2-83a5-4d12-8b71-15cf4eda80e3 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:36.599276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1001/2003] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:07:36.601254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64e8e6-c6f7-4095-9d69-32978c90b7d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:36.601816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64e8e6-c6f7-4095-9d69-32978c90b7d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.602099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64e8e6-c6f7-4095-9d69-32978c90b7d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.602373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64e8e6-c6f7-4095-9d69-32978c90b7d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.613491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64e8e6-c6f7-4095-9d69-32978c90b7d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:36.614975 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64e8e6-c6f7-4095-9d69-32978c90b7d8 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:36.626747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1003/2004] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:07:36.884897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c12ba9-007e-483d-9875-26e99a45c453 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:36.886473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-25c12ba9-007e-483d-9875-26e99a45c453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:36.909022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c12ba9-007e-483d-9875-26e99a45c453 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:36.922389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:36.923447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:36.923736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:36.924015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] PATH_INFO: `/v3/projects/995ad3f94a194c30a86a9c2b5b11935f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:36.925364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=995ad3f94a194c30a86a9c2b5b11935f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:36.927639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:36.979931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995ad3f94a194c30a86a9c2b5b11935f', 'request_id': 'req-aae800f9-8778-4817-971c-8806413e9f59'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:36.986771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995ad3f94a194c30a86a9c2b5b11935f', 'request_id': 'req-aae800f9-8778-4817-971c-8806413e9f59'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:36.993392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995ad3f94a194c30a86a9c2b5b11935f', 'request_id': 'req-aae800f9-8778-4817-971c-8806413e9f59'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:37.005001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] The token cache is being invalidate because project 995ad3f94a194c30a86a9c2b5b11935f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:37.005319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:37.005949 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-aae800f9-8778-4817-971c-8806413e9f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:37.007537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1002/2005] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:36 2022] DELETE /identity/v3/projects/995ad3f94a194c30a86a9c2b5b11935f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:37.012683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709fc7c-76d3-48ee-a2cd-5ccf4c51fc32 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.013135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709fc7c-76d3-48ee-a2cd-5ccf4c51fc32 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.013223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709fc7c-76d3-48ee-a2cd-5ccf4c51fc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.031849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f709fc7c-76d3-48ee-a2cd-5ccf4c51fc32 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:37.033059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f709fc7c-76d3-48ee-a2cd-5ccf4c51fc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:37.091533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1004/2006] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:37.099337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b660-b518-4595-a030-ce5d54bd021b None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.099634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b660-b518-4595-a030-ce5d54bd021b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.099919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b660-b518-4595-a030-ce5d54bd021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.118918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-5b53b660-b518-4595-a030-ce5d54bd021b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:37.120110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5b53b660-b518-4595-a030-ce5d54bd021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:37.127998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1003/2007] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:37.132165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709fc7c-76d3-48ee-a2cd-5ccf4c51fc32 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.142159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709fc7c-76d3-48ee-a2cd-5ccf4c51fc32 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.146942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f7713-4243-4e62-a379-68015fc1aa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.147601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f7713-4243-4e62-a379-68015fc1aa8b admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.147888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f7713-4243-4e62-a379-68015fc1aa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.148441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f7713-4243-4e62-a379-68015fc1aa8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.149189 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f7713-4243-4e62-a379-68015fc1aa8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:37.149505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f7713-4243-4e62-a379-68015fc1aa8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.151098 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f7713-4243-4e62-a379-68015fc1aa8b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.162482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1005/2008] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:07:37.167045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53b660-b518-4595-a030-ce5d54bd021b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.176061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53b660-b518-4595-a030-ce5d54bd021b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.181476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a912e5-3a44-4448-b893-dc43bdcecbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.182119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a912e5-3a44-4448-b893-dc43bdcecbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.182402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a912e5-3a44-4448-b893-dc43bdcecbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.182680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a912e5-3a44-4448-b893-dc43bdcecbb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.183370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a912e5-3a44-4448-b893-dc43bdcecbb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.185306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a912e5-3a44-4448-b893-dc43bdcecbb0 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.210676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1004/2009] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:37 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:37.214869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f7713-4243-4e62-a379-68015fc1aa8b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.226764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f7713-4243-4e62-a379-68015fc1aa8b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.285041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd25f8-e86e-4bed-b74a-4a16d71dfb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.285625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd25f8-e86e-4bed-b74a-4a16d71dfb30 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.285905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd25f8-e86e-4bed-b74a-4a16d71dfb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.286179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd25f8-e86e-4bed-b74a-4a16d71dfb30 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.286876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd25f8-e86e-4bed-b74a-4a16d71dfb30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.289471 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd25f8-e86e-4bed-b74a-4a16d71dfb30 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.313544 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1006/2010] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:37 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:37.314972 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a912e5-3a44-4448-b893-dc43bdcecbb0 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.328669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a912e5-3a44-4448-b893-dc43bdcecbb0 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.334173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04679a7-bfef-4c98-a151-d57e6a26bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.335549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04679a7-bfef-4c98-a151-d57e6a26bd36 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.336075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04679a7-bfef-4c98-a151-d57e6a26bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.336479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04679a7-bfef-4c98-a151-d57e6a26bd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.337488 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04679a7-bfef-4c98-a151-d57e6a26bd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.339262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04679a7-bfef-4c98-a151-d57e6a26bd36 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.350863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1005/2011] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:37.355170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd25f8-e86e-4bed-b74a-4a16d71dfb30 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.365306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd25f8-e86e-4bed-b74a-4a16d71dfb30 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.370882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c0d0a-27d6-4e14-87bc-70c2a42df66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.371558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c0d0a-27d6-4e14-87bc-70c2a42df66f admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.371846 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c0d0a-27d6-4e14-87bc-70c2a42df66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.372130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c0d0a-27d6-4e14-87bc-70c2a42df66f admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.372908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c0d0a-27d6-4e14-87bc-70c2a42df66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.374510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c0d0a-27d6-4e14-87bc-70c2a42df66f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.387515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1007/2012] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:37.391430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04679a7-bfef-4c98-a151-d57e6a26bd36 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.401293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04679a7-bfef-4c98-a151-d57e6a26bd36 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.405875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca89b4-0577-4b23-8f5c-a55ead92bf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.406768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca89b4-0577-4b23-8f5c-a55ead92bf6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.407048 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca89b4-0577-4b23-8f5c-a55ead92bf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.407321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca89b4-0577-4b23-8f5c-a55ead92bf6e admin admin] PATH_INFO: `/v3/projects/4f23f7bdbefa421d862c507e46e9bf87/users/8097476750db4423bee73f576838227f/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.421125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca89b4-0577-4b23-8f5c-a55ead92bf6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f23f7bdbefa421d862c507e46e9bf87, user_id=8097476750db4423bee73f576838227f, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.423805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca89b4-0577-4b23-8f5c-a55ead92bf6e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.437530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1006/2013] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:37 2022] PUT /identity/v3/projects/4f23f7bdbefa421d862c507e46e9bf87/users/8097476750db4423bee73f576838227f/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:37.448617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483be092-cf83-4bc9-acff-8482eeeae61f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.448910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483be092-cf83-4bc9-acff-8482eeeae61f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.449187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483be092-cf83-4bc9-acff-8482eeeae61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.475049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-483be092-cf83-4bc9-acff-8482eeeae61f None None] MFA Rules not processed for user `8097476750db4423bee73f576838227f`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:37.476382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-483be092-cf83-4bc9-acff-8482eeeae61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:37.537713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1008/2014] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:37.542125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca89b4-0577-4b23-8f5c-a55ead92bf6e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.603055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca89b4-0577-4b23-8f5c-a55ead92bf6e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.607661 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4bc63-4ca2-4f60-9269-ba17b3165279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.608355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4bc63-4ca2-4f60-9269-ba17b3165279 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.608640 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4bc63-4ca2-4f60-9269-ba17b3165279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.608914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4bc63-4ca2-4f60-9269-ba17b3165279 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.609594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4bc63-4ca2-4f60-9269-ba17b3165279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.611486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4bc63-4ca2-4f60-9269-ba17b3165279 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.636264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1007/2015] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:37 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:37.640497 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483be092-cf83-4bc9-acff-8482eeeae61f None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.650950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483be092-cf83-4bc9-acff-8482eeeae61f None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.705170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69bf6d-8c4d-412c-ad46-272743e81218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.705832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69bf6d-8c4d-412c-ad46-272743e81218 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.706116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69bf6d-8c4d-412c-ad46-272743e81218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.706409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69bf6d-8c4d-412c-ad46-272743e81218 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.707081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69bf6d-8c4d-412c-ad46-272743e81218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.709004 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69bf6d-8c4d-412c-ad46-272743e81218 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.729014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1009/2016] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:37 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:37.733158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4bc63-4ca2-4f60-9269-ba17b3165279 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.744065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4bc63-4ca2-4f60-9269-ba17b3165279 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.748696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242e46d-2ee1-4dba-82b6-0c75a4da1d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.749349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e46d-2ee1-4dba-82b6-0c75a4da1d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.749634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e46d-2ee1-4dba-82b6-0c75a4da1d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.749911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e46d-2ee1-4dba-82b6-0c75a4da1d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.750633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242e46d-2ee1-4dba-82b6-0c75a4da1d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.752245 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242e46d-2ee1-4dba-82b6-0c75a4da1d2c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.762506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1008/2017] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:37.766980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69bf6d-8c4d-412c-ad46-272743e81218 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.777340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69bf6d-8c4d-412c-ad46-272743e81218 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.781875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5402f-ddef-44ff-a50a-abcf680572db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.782741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5402f-ddef-44ff-a50a-abcf680572db admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.783021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5402f-ddef-44ff-a50a-abcf680572db admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.783290 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5402f-ddef-44ff-a50a-abcf680572db admin admin] PATH_INFO: `/v3/projects/88f2034bbf38442ab4ebcf45f3729c23/users/f2b95957a5cc473ebeda35f17e729486/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.798049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5402f-ddef-44ff-a50a-abcf680572db admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f2034bbf38442ab4ebcf45f3729c23, user_id=f2b95957a5cc473ebeda35f17e729486, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.800645 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5402f-ddef-44ff-a50a-abcf680572db admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.813462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1010/2018] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:37 2022] PUT /identity/v3/projects/88f2034bbf38442ab4ebcf45f3729c23/users/f2b95957a5cc473ebeda35f17e729486/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:37.817304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242e46d-2ee1-4dba-82b6-0c75a4da1d2c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.827397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242e46d-2ee1-4dba-82b6-0c75a4da1d2c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.881655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe85e87-716a-48a0-bcac-631961cec2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.882360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe85e87-716a-48a0-bcac-631961cec2fb admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.882634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe85e87-716a-48a0-bcac-631961cec2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.882931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe85e87-716a-48a0-bcac-631961cec2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.883651 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe85e87-716a-48a0-bcac-631961cec2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.885268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe85e87-716a-48a0-bcac-631961cec2fb admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.895085 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1009/2019] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:07:37.899562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5402f-ddef-44ff-a50a-abcf680572db admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:37.909766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5402f-ddef-44ff-a50a-abcf680572db admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:37.915053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8eb21-10ae-4c76-9ac2-b5103d6f593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:37.915929 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8eb21-10ae-4c76-9ac2-b5103d6f593b admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.916239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8eb21-10ae-4c76-9ac2-b5103d6f593b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.916656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8eb21-10ae-4c76-9ac2-b5103d6f593b admin admin] PATH_INFO: `/v3/projects/88f2034bbf38442ab4ebcf45f3729c23/users/f2b95957a5cc473ebeda35f17e729486/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.918624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8eb21-10ae-4c76-9ac2-b5103d6f593b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f2034bbf38442ab4ebcf45f3729c23, user_id=f2b95957a5cc473ebeda35f17e729486, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:37.921288 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8eb21-10ae-4c76-9ac2-b5103d6f593b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:37.932065 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1011/2020] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:37 2022] PUT /identity/v3/projects/88f2034bbf38442ab4ebcf45f3729c23/users/f2b95957a5cc473ebeda35f17e729486/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:07:37.943291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611e617-7611-405f-a0d2-2fbb6c6adeae None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:37.943589 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611e617-7611-405f-a0d2-2fbb6c6adeae None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:37.944075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611e617-7611-405f-a0d2-2fbb6c6adeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:37.971214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-4611e617-7611-405f-a0d2-2fbb6c6adeae None None] MFA Rules not processed for user `f2b95957a5cc473ebeda35f17e729486`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:37.972473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4611e617-7611-405f-a0d2-2fbb6c6adeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:38.038012 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1010/2021] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:38.050454 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8eb21-10ae-4c76-9ac2-b5103d6f593b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:38.052084 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b4d8eb21-10ae-4c76-9ac2-b5103d6f593b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:38.106838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8eb21-10ae-4c76-9ac2-b5103d6f593b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:38.110430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe02076-2c44-4986-a00e-e9a31a41e5ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:38.111068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe02076-2c44-4986-a00e-e9a31a41e5ef service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:38.111351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe02076-2c44-4986-a00e-e9a31a41e5ef service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:38.111631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe02076-2c44-4986-a00e-e9a31a41e5ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:38.120558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe02076-2c44-4986-a00e-e9a31a41e5ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:38.121973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe02076-2c44-4986-a00e-e9a31a41e5ef service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:38.131187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1012/2022] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:38.201674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611e617-7611-405f-a0d2-2fbb6c6adeae None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:38.211460 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611e617-7611-405f-a0d2-2fbb6c6adeae None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:38.215056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd5b05-356e-4d47-94a6-e147abd24d32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:38.215691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd5b05-356e-4d47-94a6-e147abd24d32 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:38.215975 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd5b05-356e-4d47-94a6-e147abd24d32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:38.216290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd5b05-356e-4d47-94a6-e147abd24d32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:38.271814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd5b05-356e-4d47-94a6-e147abd24d32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:38.273785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd5b05-356e-4d47-94a6-e147abd24d32 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:38.282516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1011/2023] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:42.904874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe02076-2c44-4986-a00e-e9a31a41e5ef service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:42.906258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1fe02076-2c44-4986-a00e-e9a31a41e5ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:42.970933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe02076-2c44-4986-a00e-e9a31a41e5ef service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:42.975395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:42.976288 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:42.976577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:42.976853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] PATH_INFO: `/v3/users/46438fbece5b49f484cc4ae71a817bad` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:42.978620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46438fbece5b49f484cc4ae71a817bad)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:42.980576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:43.025653 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46438fbece5b49f484cc4ae71a817bad'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:43.032510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46438fbece5b49f484cc4ae71a817bad'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:43.040094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46438fbece5b49f484cc4ae71a817bad'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:43.040747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46438fbece5b49f484cc4ae71a817bad'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:43.041369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46438fbece5b49f484cc4ae71a817bad'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:43.060113 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1013/2024] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:42 2022] DELETE /identity/v3/users/46438fbece5b49f484cc4ae71a817bad => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:43.064854 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2180-27d1-48be-8f77-20ed3f475f9f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:43.065352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2180-27d1-48be-8f77-20ed3f475f9f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:43.065457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2180-27d1-48be-8f77-20ed3f475f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:43.083496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-83fb2180-27d1-48be-8f77-20ed3f475f9f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:43.084619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-83fb2180-27d1-48be-8f77-20ed3f475f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:43.149005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1012/2025] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:43.153971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:43.155386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:43.222055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b73644-99f9-4798-8c94-b257f1d00e58 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:43.226194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e307d6-e1dc-4139-8d52-5174fb102374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:43.226839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e307d6-e1dc-4139-8d52-5174fb102374 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:43.227221 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e307d6-e1dc-4139-8d52-5174fb102374 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:43.227535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e307d6-e1dc-4139-8d52-5174fb102374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:43.237901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e307d6-e1dc-4139-8d52-5174fb102374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:43.239557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e307d6-e1dc-4139-8d52-5174fb102374 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:43.251099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1014/2026] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:43.517791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb2180-27d1-48be-8f77-20ed3f475f9f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:43.519307 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-83fb2180-27d1-48be-8f77-20ed3f475f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:43.538055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb2180-27d1-48be-8f77-20ed3f475f9f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:43.544497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:43.546027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:43.546575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:43.546707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] PATH_INFO: `/v3/projects/97a5c28bb5be4d43a607ebf906c1a67c` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:43.548340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a5c28bb5be4d43a607ebf906c1a67c)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:43.550422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:43.597708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a5c28bb5be4d43a607ebf906c1a67c', 'request_id': 'req-4fc3300d-414b-4e18-9208-085d3703f71a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:43.604362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a5c28bb5be4d43a607ebf906c1a67c', 'request_id': 'req-4fc3300d-414b-4e18-9208-085d3703f71a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:43.609606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a5c28bb5be4d43a607ebf906c1a67c', 'request_id': 'req-4fc3300d-414b-4e18-9208-085d3703f71a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:43.621635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] The token cache is being invalidate because project 97a5c28bb5be4d43a607ebf906c1a67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:43.621916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:43.622522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4fc3300d-414b-4e18-9208-085d3703f71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:43.624034 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1013/2027] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:43 2022] DELETE /identity/v3/projects/97a5c28bb5be4d43a607ebf906c1a67c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:43.629179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc9265-fd02-4cac-8cf5-d44eaf4c2e93 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:43.629473 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc9265-fd02-4cac-8cf5-d44eaf4c2e93 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:43.629754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc9265-fd02-4cac-8cf5-d44eaf4c2e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:43.646876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-77fc9265-fd02-4cac-8cf5-d44eaf4c2e93 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:43.648038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-77fc9265-fd02-4cac-8cf5-d44eaf4c2e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:43.711160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1015/2028] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:43.719936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efb3a9-a5ea-415a-986a-c396e974c602 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:43.720345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efb3a9-a5ea-415a-986a-c396e974c602 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:43.720687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efb3a9-a5ea-415a-986a-c396e974c602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:43.741046 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-d2efb3a9-a5ea-415a-986a-c396e974c602 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:43.742256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-d2efb3a9-a5ea-415a-986a-c396e974c602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:43.751104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1014/2029] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:43.755227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc9265-fd02-4cac-8cf5-d44eaf4c2e93 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:43.765173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc9265-fd02-4cac-8cf5-d44eaf4c2e93 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:43.769968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665180-146e-4bec-9556-c6d679e94d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:43.770792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665180-146e-4bec-9556-c6d679e94d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:43.771102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665180-146e-4bec-9556-c6d679e94d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:43.771381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665180-146e-4bec-9556-c6d679e94d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:43.772102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09665180-146e-4bec-9556-c6d679e94d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:43.772543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09665180-146e-4bec-9556-c6d679e94d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:43.774226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09665180-146e-4bec-9556-c6d679e94d97 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:43.785878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1016/2030] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:07:43.790842 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efb3a9-a5ea-415a-986a-c396e974c602 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:43.799861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efb3a9-a5ea-415a-986a-c396e974c602 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:43.804593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d9181-f81b-42ac-bfaa-793360b496a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:43.805811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d9181-f81b-42ac-bfaa-793360b496a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:43.806097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d9181-f81b-42ac-bfaa-793360b496a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:43.806464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d9181-f81b-42ac-bfaa-793360b496a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:43.807160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d9181-f81b-42ac-bfaa-793360b496a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:43.809103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d9181-f81b-42ac-bfaa-793360b496a8 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:43.833787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1015/2031] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:43 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:43.837931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665180-146e-4bec-9556-c6d679e94d97 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:43.847719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665180-146e-4bec-9556-c6d679e94d97 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:43.901688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc3a6f-9f78-4dd1-8c5b-cfbc54c0eb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:43.902277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc3a6f-9f78-4dd1-8c5b-cfbc54c0eb2f admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:43.902564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc3a6f-9f78-4dd1-8c5b-cfbc54c0eb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:43.902843 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc3a6f-9f78-4dd1-8c5b-cfbc54c0eb2f admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:43.903535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc3a6f-9f78-4dd1-8c5b-cfbc54c0eb2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:43.905485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc3a6f-9f78-4dd1-8c5b-cfbc54c0eb2f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:43.925527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1017/2032] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:43 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:43.929677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d9181-f81b-42ac-bfaa-793360b496a8 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:43.940481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d9181-f81b-42ac-bfaa-793360b496a8 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:43.945550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f791e-a2e7-43cd-a5b6-35f59b179a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:43.946245 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f791e-a2e7-43cd-a5b6-35f59b179a12 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:43.946529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f791e-a2e7-43cd-a5b6-35f59b179a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:43.946812 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f791e-a2e7-43cd-a5b6-35f59b179a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:43.947536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f791e-a2e7-43cd-a5b6-35f59b179a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:43.949176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f791e-a2e7-43cd-a5b6-35f59b179a12 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:43.959339 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1016/2033] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:43.963755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc3a6f-9f78-4dd1-8c5b-cfbc54c0eb2f admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:43.973327 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc3a6f-9f78-4dd1-8c5b-cfbc54c0eb2f admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:43.978527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff70f1-86bf-4dda-babe-50a35560a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:43.979166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff70f1-86bf-4dda-babe-50a35560a886 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:43.979477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff70f1-86bf-4dda-babe-50a35560a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:43.979752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff70f1-86bf-4dda-babe-50a35560a886 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:43.980512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff70f1-86bf-4dda-babe-50a35560a886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:43.982086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff70f1-86bf-4dda-babe-50a35560a886 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:43.993104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1018/2034] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:07:43.997012 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f791e-a2e7-43cd-a5b6-35f59b179a12 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:44.006633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f791e-a2e7-43cd-a5b6-35f59b179a12 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:44.011166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217a07b-76bf-4ec7-9ee6-f2c4f08e261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:44.012029 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217a07b-76bf-4ec7-9ee6-f2c4f08e261b admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:44.012355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217a07b-76bf-4ec7-9ee6-f2c4f08e261b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:44.012636 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217a07b-76bf-4ec7-9ee6-f2c4f08e261b admin admin] PATH_INFO: `/v3/projects/32913e94c64f4a2aba0e99925eb60a6f/users/bf87d0170b824f3cac8ab3a4a0271221/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:44.027029 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217a07b-76bf-4ec7-9ee6-f2c4f08e261b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32913e94c64f4a2aba0e99925eb60a6f, user_id=bf87d0170b824f3cac8ab3a4a0271221, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:44.029708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217a07b-76bf-4ec7-9ee6-f2c4f08e261b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:44.042379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1017/2035] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:43 2022] PUT /identity/v3/projects/32913e94c64f4a2aba0e99925eb60a6f/users/bf87d0170b824f3cac8ab3a4a0271221/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:44.052668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72edd-0c9c-4f56-9686-0a99f71d69ba None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:44.052985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72edd-0c9c-4f56-9686-0a99f71d69ba None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:44.053316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72edd-0c9c-4f56-9686-0a99f71d69ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:44.079547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-07a72edd-0c9c-4f56-9686-0a99f71d69ba None None] MFA Rules not processed for user `bf87d0170b824f3cac8ab3a4a0271221`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:44.080778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-07a72edd-0c9c-4f56-9686-0a99f71d69ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:44.151924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1019/2036] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:44.163034 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217a07b-76bf-4ec7-9ee6-f2c4f08e261b admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:44.166074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4217a07b-76bf-4ec7-9ee6-f2c4f08e261b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:44.220265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217a07b-76bf-4ec7-9ee6-f2c4f08e261b admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:44.223904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e116b2b-88c4-40d7-8613-d6fcee43b83b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:44.224574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e116b2b-88c4-40d7-8613-d6fcee43b83b service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:44.224862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e116b2b-88c4-40d7-8613-d6fcee43b83b service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:44.225145 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e116b2b-88c4-40d7-8613-d6fcee43b83b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:44.233930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e116b2b-88c4-40d7-8613-d6fcee43b83b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:44.235361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e116b2b-88c4-40d7-8613-d6fcee43b83b service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:44.244074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1018/2037] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:44.267907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72edd-0c9c-4f56-9686-0a99f71d69ba None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:44.335128 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72edd-0c9c-4f56-9686-0a99f71d69ba None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:44.340368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:44.341249 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:44.341531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:44.341805 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] PATH_INFO: `/v3/users/bf87d0170b824f3cac8ab3a4a0271221` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:44.343043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf87d0170b824f3cac8ab3a4a0271221)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:44.345001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:44.393184 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf87d0170b824f3cac8ab3a4a0271221'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:44.400580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf87d0170b824f3cac8ab3a4a0271221'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:44.409829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf87d0170b824f3cac8ab3a4a0271221'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:44.411023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf87d0170b824f3cac8ab3a4a0271221'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:44.411668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf87d0170b824f3cac8ab3a4a0271221'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:44.429818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1020/2038] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:44 2022] DELETE /identity/v3/users/bf87d0170b824f3cac8ab3a4a0271221 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:44.435243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e023-115c-4a80-b592-15643877014d None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:44.435539 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e023-115c-4a80-b592-15643877014d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:44.435819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e023-115c-4a80-b592-15643877014d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:44.452968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a318e023-115c-4a80-b592-15643877014d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:44.454156 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a318e023-115c-4a80-b592-15643877014d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:44.511627 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1019/2039] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:44.521130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:44.522526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:44.579953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99973dcd-5836-4f58-a228-a5d7c9ead155 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:44.583587 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab780c3-ad98-49db-8b68-6b94e2344f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:44.584256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab780c3-ad98-49db-8b68-6b94e2344f65 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:44.584543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab780c3-ad98-49db-8b68-6b94e2344f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:44.584823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab780c3-ad98-49db-8b68-6b94e2344f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:44.594283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab780c3-ad98-49db-8b68-6b94e2344f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:44.595697 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab780c3-ad98-49db-8b68-6b94e2344f65 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:44.605068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1021/2040] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:44.865589 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318e023-115c-4a80-b592-15643877014d None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:44.867087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a318e023-115c-4a80-b592-15643877014d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:44.879770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318e023-115c-4a80-b592-15643877014d None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:44.884986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:44.885925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:44.886271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:44.886631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] PATH_INFO: `/v3/projects/32913e94c64f4a2aba0e99925eb60a6f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:44.887964 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32913e94c64f4a2aba0e99925eb60a6f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:44.890358 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:44.935600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32913e94c64f4a2aba0e99925eb60a6f', 'request_id': 'req-3068867b-a155-4e51-b6b1-02eb6c4165d1'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:44.941569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32913e94c64f4a2aba0e99925eb60a6f', 'request_id': 'req-3068867b-a155-4e51-b6b1-02eb6c4165d1'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:44.948020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32913e94c64f4a2aba0e99925eb60a6f', 'request_id': 'req-3068867b-a155-4e51-b6b1-02eb6c4165d1'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:44.959204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] The token cache is being invalidate because project 32913e94c64f4a2aba0e99925eb60a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:44.959494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:44.960125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3068867b-a155-4e51-b6b1-02eb6c4165d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:44.961685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1020/2041] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:44 2022] DELETE /identity/v3/projects/32913e94c64f4a2aba0e99925eb60a6f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:44.966662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfc21b-fd69-4553-870f-651365e0bbc3 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:44.967127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfc21b-fd69-4553-870f-651365e0bbc3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:44.967228 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfc21b-fd69-4553-870f-651365e0bbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:44.984323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-eccfc21b-fd69-4553-870f-651365e0bbc3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:44.985502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-eccfc21b-fd69-4553-870f-651365e0bbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:45.042520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1022/2042] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:45.051370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef02d9-afd5-4838-ae2d-4a06b3596510 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:45.051667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef02d9-afd5-4838-ae2d-4a06b3596510 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:45.051950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef02d9-afd5-4838-ae2d-4a06b3596510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:45.070546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-b4ef02d9-afd5-4838-ae2d-4a06b3596510 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:45.072564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b4ef02d9-afd5-4838-ae2d-4a06b3596510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:45.080771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1021/2043] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:45.084876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfc21b-fd69-4553-870f-651365e0bbc3 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:45.094397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfc21b-fd69-4553-870f-651365e0bbc3 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:45.098892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44338d57-f857-4dd9-9b3b-ce0af5464d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:45.099545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338d57-f857-4dd9-9b3b-ce0af5464d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:45.099827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338d57-f857-4dd9-9b3b-ce0af5464d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:45.100102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44338d57-f857-4dd9-9b3b-ce0af5464d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:45.100851 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44338d57-f857-4dd9-9b3b-ce0af5464d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:45.101155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44338d57-f857-4dd9-9b3b-ce0af5464d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:45.103361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44338d57-f857-4dd9-9b3b-ce0af5464d94 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:45.114482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1023/2044] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:07:45.119202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef02d9-afd5-4838-ae2d-4a06b3596510 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:45.127986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef02d9-afd5-4838-ae2d-4a06b3596510 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:45.132591 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55822ebb-f7d4-4608-b9c1-b6c1f1059723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:45.133266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822ebb-f7d4-4608-b9c1-b6c1f1059723 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:45.133549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822ebb-f7d4-4608-b9c1-b6c1f1059723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:45.133823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822ebb-f7d4-4608-b9c1-b6c1f1059723 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:45.134496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55822ebb-f7d4-4608-b9c1-b6c1f1059723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:45.136397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55822ebb-f7d4-4608-b9c1-b6c1f1059723 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:45.160810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1022/2045] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:45 2022] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:45.165373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44338d57-f857-4dd9-9b3b-ce0af5464d94 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:45.175131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44338d57-f857-4dd9-9b3b-ce0af5464d94 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:45.230066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ef770-77e7-4b0e-bc36-b90a6fdf5f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:45.230675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ef770-77e7-4b0e-bc36-b90a6fdf5f70 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:45.230959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ef770-77e7-4b0e-bc36-b90a6fdf5f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:45.231233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ef770-77e7-4b0e-bc36-b90a6fdf5f70 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:45.231926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ef770-77e7-4b0e-bc36-b90a6fdf5f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:45.233868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ef770-77e7-4b0e-bc36-b90a6fdf5f70 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:45.252391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1024/2046] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:45 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:45.256559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55822ebb-f7d4-4608-b9c1-b6c1f1059723 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:45.267044 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55822ebb-f7d4-4608-b9c1-b6c1f1059723 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:45.271621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a9252-996d-4223-847e-31a21d76e8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:45.272310 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a9252-996d-4223-847e-31a21d76e8ee admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:45.272594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a9252-996d-4223-847e-31a21d76e8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:45.272869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a9252-996d-4223-847e-31a21d76e8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:45.273587 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a9252-996d-4223-847e-31a21d76e8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:45.275807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a9252-996d-4223-847e-31a21d76e8ee admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:45.285810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1023/2047] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:07:45.289749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ef770-77e7-4b0e-bc36-b90a6fdf5f70 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:45.299396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ef770-77e7-4b0e-bc36-b90a6fdf5f70 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:45.303979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d8415-7059-4924-a6c7-a469be63b499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:45.304643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d8415-7059-4924-a6c7-a469be63b499 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:45.304927 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d8415-7059-4924-a6c7-a469be63b499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:45.305306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d8415-7059-4924-a6c7-a469be63b499 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:45.306036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d8415-7059-4924-a6c7-a469be63b499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:45.307617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d8415-7059-4924-a6c7-a469be63b499 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:45.320404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1025/2048] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:45.322459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a9252-996d-4223-847e-31a21d76e8ee admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:45.334656 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a9252-996d-4223-847e-31a21d76e8ee admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:45.340664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312da832-5959-414d-970a-04fd311454de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:45.341498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312da832-5959-414d-970a-04fd311454de admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:45.341777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312da832-5959-414d-970a-04fd311454de admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:45.342047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312da832-5959-414d-970a-04fd311454de admin admin] PATH_INFO: `/v3/projects/97511db3040c4ee8ba85614ef5eccd3f/users/508be73ddefa4429888114092480bf5f/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:45.356750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312da832-5959-414d-970a-04fd311454de admin admin] RBAC: Authorizing `identity:create_grant(project_id=97511db3040c4ee8ba85614ef5eccd3f, user_id=508be73ddefa4429888114092480bf5f, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:45.359467 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312da832-5959-414d-970a-04fd311454de admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:45.372566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1024/2049] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:45 2022] PUT /identity/v3/projects/97511db3040c4ee8ba85614ef5eccd3f/users/508be73ddefa4429888114092480bf5f/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:45.382674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e5a42-1623-42a4-9035-8cc8886f87d4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:45.382973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e5a42-1623-42a4-9035-8cc8886f87d4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:45.383774 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e5a42-1623-42a4-9035-8cc8886f87d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:45.411062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-793e5a42-1623-42a4-9035-8cc8886f87d4 None None] MFA Rules not processed for user `508be73ddefa4429888114092480bf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:45.412276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-793e5a42-1623-42a4-9035-8cc8886f87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:45.476051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1026/2050] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:45.487487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312da832-5959-414d-970a-04fd311454de admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:45.489693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-312da832-5959-414d-970a-04fd311454de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:45.552673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312da832-5959-414d-970a-04fd311454de admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:45.557430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca7dc5-f71c-454a-af70-0a0f5fb57cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:45.558097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca7dc5-f71c-454a-af70-0a0f5fb57cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:45.558383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca7dc5-f71c-454a-af70-0a0f5fb57cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:45.558659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca7dc5-f71c-454a-af70-0a0f5fb57cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:45.567269 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca7dc5-f71c-454a-af70-0a0f5fb57cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:45.568749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca7dc5-f71c-454a-af70-0a0f5fb57cb4 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:45.578200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1025/2051] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:48.678542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e5a42-1623-42a4-9035-8cc8886f87d4 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:48.679990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-793e5a42-1623-42a4-9035-8cc8886f87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:48.749026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e5a42-1623-42a4-9035-8cc8886f87d4 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:48.754700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:48.755569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:48.755853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:48.756130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] PATH_INFO: `/v3/users/738da53efbd34b91a7093a86c8d5aaa4` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:48.757382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=738da53efbd34b91a7093a86c8d5aaa4)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:48.759909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:48.808519 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738da53efbd34b91a7093a86c8d5aaa4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:48.815159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738da53efbd34b91a7093a86c8d5aaa4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:48.824060 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738da53efbd34b91a7093a86c8d5aaa4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:48.824923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738da53efbd34b91a7093a86c8d5aaa4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:48.825672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738da53efbd34b91a7093a86c8d5aaa4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:48.843243 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1027/2052] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:48 2022] DELETE /identity/v3/users/738da53efbd34b91a7093a86c8d5aaa4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:48.847840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcf205-3707-489d-a37c-0e603e161b3d None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:48.848341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcf205-3707-489d-a37c-0e603e161b3d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:48.848548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcf205-3707-489d-a37c-0e603e161b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:48.867019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-6fbcf205-3707-489d-a37c-0e603e161b3d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:48.868409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6fbcf205-3707-489d-a37c-0e603e161b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:48.925790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1026/2053] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:48.937267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:48.939626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:49.001576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a0838-bae4-43aa-8def-59bda2363cf2 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:49.005609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8138fec-5ce4-45f8-9302-777eeb3e9e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:49.006253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8138fec-5ce4-45f8-9302-777eeb3e9e39 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:49.006535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8138fec-5ce4-45f8-9302-777eeb3e9e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:49.006809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8138fec-5ce4-45f8-9302-777eeb3e9e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:49.016873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8138fec-5ce4-45f8-9302-777eeb3e9e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:49.018299 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8138fec-5ce4-45f8-9302-777eeb3e9e39 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:49.029017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1028/2054] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:49.354616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcf205-3707-489d-a37c-0e603e161b3d None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:49.356272 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6fbcf205-3707-489d-a37c-0e603e161b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:49.369636 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcf205-3707-489d-a37c-0e603e161b3d None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:49.374490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:49.375438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:49.375953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:49.376336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] PATH_INFO: `/v3/projects/4c4caedce53046b3ac3f6d08ef718606` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:49.377666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4caedce53046b3ac3f6d08ef718606)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:49.379703 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:49.458924 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4caedce53046b3ac3f6d08ef718606', 'request_id': 'req-92c86bf6-7ab5-49b2-b213-1c7ef578d818'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:49.465795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4caedce53046b3ac3f6d08ef718606', 'request_id': 'req-92c86bf6-7ab5-49b2-b213-1c7ef578d818'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:49.471252 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4caedce53046b3ac3f6d08ef718606', 'request_id': 'req-92c86bf6-7ab5-49b2-b213-1c7ef578d818'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:49.484495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] The token cache is being invalidate because project 4c4caedce53046b3ac3f6d08ef718606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:49.484865 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:49.485998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:49.487962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1027/2055] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:49 2022] DELETE /identity/v3/projects/4c4caedce53046b3ac3f6d08ef718606 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:49.493060 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8138fec-5ce4-45f8-9302-777eeb3e9e39 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:49.503615 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8138fec-5ce4-45f8-9302-777eeb3e9e39 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:49.565358 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b5a9c-69c9-4b4f-b41f-a03dc222544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:49.566283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b5a9c-69c9-4b4f-b41f-a03dc222544a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:49.566562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b5a9c-69c9-4b4f-b41f-a03dc222544a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:49.566874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b5a9c-69c9-4b4f-b41f-a03dc222544a admin admin] PATH_INFO: `/v3/users/42694d3b8b60423e87833d18bed9b81c` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:49.568099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b5a9c-69c9-4b4f-b41f-a03dc222544a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42694d3b8b60423e87833d18bed9b81c)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:49.570326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b5a9c-69c9-4b4f-b41f-a03dc222544a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:49.621105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d47b5a9c-69c9-4b4f-b41f-a03dc222544a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42694d3b8b60423e87833d18bed9b81c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:49.628026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d47b5a9c-69c9-4b4f-b41f-a03dc222544a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42694d3b8b60423e87833d18bed9b81c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:49.635710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d47b5a9c-69c9-4b4f-b41f-a03dc222544a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42694d3b8b60423e87833d18bed9b81c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:49.636356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d47b5a9c-69c9-4b4f-b41f-a03dc222544a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42694d3b8b60423e87833d18bed9b81c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:49.636962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d47b5a9c-69c9-4b4f-b41f-a03dc222544a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42694d3b8b60423e87833d18bed9b81c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:49.654379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1029/2056] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:49 2022] DELETE /identity/v3/users/42694d3b8b60423e87833d18bed9b81c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:49.932312 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:49.933758 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:49.947548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c86bf6-7ab5-49b2-b213-1c7ef578d818 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:50.004963 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:50.005817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.006096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.006370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] PATH_INFO: `/v3/projects/00793ecd38e343999d952e8993485a83` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.007533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00793ecd38e343999d952e8993485a83)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:50.010092 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:50.053213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00793ecd38e343999d952e8993485a83', 'request_id': 'req-122bc45c-e34b-4017-b1bc-3744cc3c7f06'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:50.059769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00793ecd38e343999d952e8993485a83', 'request_id': 'req-122bc45c-e34b-4017-b1bc-3744cc3c7f06'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:50.065020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00793ecd38e343999d952e8993485a83', 'request_id': 'req-122bc45c-e34b-4017-b1bc-3744cc3c7f06'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:50.078157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] The token cache is being invalidate because project 00793ecd38e343999d952e8993485a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:50.078446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:50.079072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-122bc45c-e34b-4017-b1bc-3744cc3c7f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:50.080689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1028/2057] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:49 2022] DELETE /identity/v3/projects/00793ecd38e343999d952e8993485a83 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:50.086909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566b78-435e-478a-8551-f331d4a6579f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.087356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566b78-435e-478a-8551-f331d4a6579f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.087465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566b78-435e-478a-8551-f331d4a6579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.104553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a8566b78-435e-478a-8551-f331d4a6579f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:50.105739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a8566b78-435e-478a-8551-f331d4a6579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:50.165272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1030/2058] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:50.173617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e547-066e-4823-a84b-08feecaa6748 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.173911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e547-066e-4823-a84b-08feecaa6748 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.174213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e547-066e-4823-a84b-08feecaa6748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.192440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-92b4e547-066e-4823-a84b-08feecaa6748 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:50.193636 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-92b4e547-066e-4823-a84b-08feecaa6748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:50.202155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1029/2059] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:50.206418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566b78-435e-478a-8551-f331d4a6579f None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:50.216935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566b78-435e-478a-8551-f331d4a6579f None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:50.221574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672bf4-314f-4471-8a29-4b9cbe3dd526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:50.222233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672bf4-314f-4471-8a29-4b9cbe3dd526 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.222546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672bf4-314f-4471-8a29-4b9cbe3dd526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.222825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672bf4-314f-4471-8a29-4b9cbe3dd526 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.223557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1672bf4-314f-4471-8a29-4b9cbe3dd526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:50.223865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1672bf4-314f-4471-8a29-4b9cbe3dd526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:50.225532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1672bf4-314f-4471-8a29-4b9cbe3dd526 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:50.237824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1031/2060] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:07:50.242188 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e547-066e-4823-a84b-08feecaa6748 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:50.251579 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e547-066e-4823-a84b-08feecaa6748 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:50.256225 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f7277-7ff9-468b-bc57-1aac59beb44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:50.256876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f7277-7ff9-468b-bc57-1aac59beb44a admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.257156 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f7277-7ff9-468b-bc57-1aac59beb44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.257430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f7277-7ff9-468b-bc57-1aac59beb44a admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.258125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f7277-7ff9-468b-bc57-1aac59beb44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:50.260201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f7277-7ff9-468b-bc57-1aac59beb44a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:50.286155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1030/2061] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:50 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:50.290882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672bf4-314f-4471-8a29-4b9cbe3dd526 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:50.300526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672bf4-314f-4471-8a29-4b9cbe3dd526 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:50.358609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e129f-2151-43ef-832a-5f14690a99b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:50.359287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e129f-2151-43ef-832a-5f14690a99b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.359574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e129f-2151-43ef-832a-5f14690a99b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.359853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e129f-2151-43ef-832a-5f14690a99b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.360611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e129f-2151-43ef-832a-5f14690a99b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:50.362478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e129f-2151-43ef-832a-5f14690a99b7 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:50.384334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1032/2062] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:50 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:07:50.387911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f7277-7ff9-468b-bc57-1aac59beb44a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:50.398515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f7277-7ff9-468b-bc57-1aac59beb44a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:50.403775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476163c2-07a4-4f2f-9dd8-335ce56a864e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:50.404462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476163c2-07a4-4f2f-9dd8-335ce56a864e admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.404743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476163c2-07a4-4f2f-9dd8-335ce56a864e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.405136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476163c2-07a4-4f2f-9dd8-335ce56a864e admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.405863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476163c2-07a4-4f2f-9dd8-335ce56a864e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:50.407472 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476163c2-07a4-4f2f-9dd8-335ce56a864e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:50.417942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1031/2063] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:50.421748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e129f-2151-43ef-832a-5f14690a99b7 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:50.431625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e129f-2151-43ef-832a-5f14690a99b7 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:50.436304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bc986-25cd-445c-831f-5813676e673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:50.436973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bc986-25cd-445c-831f-5813676e673b admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.437239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bc986-25cd-445c-831f-5813676e673b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.437557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bc986-25cd-445c-831f-5813676e673b admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.438389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bc986-25cd-445c-831f-5813676e673b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:50.440015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bc986-25cd-445c-831f-5813676e673b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:50.451186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1033/2064] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:07:50.456144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476163c2-07a4-4f2f-9dd8-335ce56a864e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:50.468445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476163c2-07a4-4f2f-9dd8-335ce56a864e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:50.473377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9acacd-dad3-4bce-8a18-ef03b24b33d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:50.474256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9acacd-dad3-4bce-8a18-ef03b24b33d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.474536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9acacd-dad3-4bce-8a18-ef03b24b33d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.474810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9acacd-dad3-4bce-8a18-ef03b24b33d8 admin admin] PATH_INFO: `/v3/projects/7bf544717521417db2c36f600ab557a5/users/ee4ebe394c394c46a9723d226c7d0cdb/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.491947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9acacd-dad3-4bce-8a18-ef03b24b33d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf544717521417db2c36f600ab557a5, user_id=ee4ebe394c394c46a9723d226c7d0cdb, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:50.495157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9acacd-dad3-4bce-8a18-ef03b24b33d8 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:50.518600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1032/2065] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:50 2022] PUT /identity/v3/projects/7bf544717521417db2c36f600ab557a5/users/ee4ebe394c394c46a9723d226c7d0cdb/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:50.532559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0dce8-4d13-4b72-93d7-04f4048283f8 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.533053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0dce8-4d13-4b72-93d7-04f4048283f8 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.533471 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0dce8-4d13-4b72-93d7-04f4048283f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.573971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-91e0dce8-4d13-4b72-93d7-04f4048283f8 None None] MFA Rules not processed for user `ee4ebe394c394c46a9723d226c7d0cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:50.575282 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-91e0dce8-4d13-4b72-93d7-04f4048283f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:50.651439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1034/2066] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:50.712776 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9acacd-dad3-4bce-8a18-ef03b24b33d8 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:50.717364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3f9acacd-dad3-4bce-8a18-ef03b24b33d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:50.796282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9acacd-dad3-4bce-8a18-ef03b24b33d8 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:50.800315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f583d86-acb4-4ea7-9fd6-1bd50c98fba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:50.801365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583d86-acb4-4ea7-9fd6-1bd50c98fba2 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.801710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583d86-acb4-4ea7-9fd6-1bd50c98fba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.802068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583d86-acb4-4ea7-9fd6-1bd50c98fba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.812195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f583d86-acb4-4ea7-9fd6-1bd50c98fba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:50.813761 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f583d86-acb4-4ea7-9fd6-1bd50c98fba2 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:50.832516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1033/2067] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:50.853825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0dce8-4d13-4b72-93d7-04f4048283f8 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:50.938246 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0dce8-4d13-4b72-93d7-04f4048283f8 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:50.942866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:50.943725 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:50.944002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:50.944303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] PATH_INFO: `/v3/users/ee4ebe394c394c46a9723d226c7d0cdb` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:50.946569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4ebe394c394c46a9723d226c7d0cdb)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:50.948750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:51.001396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4ebe394c394c46a9723d226c7d0cdb'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:51.007980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4ebe394c394c46a9723d226c7d0cdb'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:51.015512 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4ebe394c394c46a9723d226c7d0cdb'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:51.016155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4ebe394c394c46a9723d226c7d0cdb'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:51.016806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4ebe394c394c46a9723d226c7d0cdb'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:51.034359 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1035/2068] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:07:50 2022] DELETE /identity/v3/users/ee4ebe394c394c46a9723d226c7d0cdb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:51.039421 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119eca9-99bc-4b6c-9f86-ce9536035128 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:51.040541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119eca9-99bc-4b6c-9f86-ce9536035128 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:51.040832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119eca9-99bc-4b6c-9f86-ce9536035128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:51.060470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1119eca9-99bc-4b6c-9f86-ce9536035128 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:51.061597 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1119eca9-99bc-4b6c-9f86-ce9536035128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:51.124990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1034/2069] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:51.135579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:51.137232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:51.205203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05036f9e-2229-47b9-b789-6d101bdb3bfc admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:51.208976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5a941-edb5-4e41-8248-6f757df8301f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:51.209618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5a941-edb5-4e41-8248-6f757df8301f service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:51.209901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5a941-edb5-4e41-8248-6f757df8301f service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:51.210178 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5a941-edb5-4e41-8248-6f757df8301f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:51.221511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5a941-edb5-4e41-8248-6f757df8301f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:51.223754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5a941-edb5-4e41-8248-6f757df8301f service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:51.235484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1036/2070] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:07:51.522879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119eca9-99bc-4b6c-9f86-ce9536035128 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:51.524635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1119eca9-99bc-4b6c-9f86-ce9536035128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:51.544413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119eca9-99bc-4b6c-9f86-ce9536035128 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:51.553283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:51.554394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:51.554840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:51.555788 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] PATH_INFO: `/v3/projects/7bf544717521417db2c36f600ab557a5` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:51.557208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf544717521417db2c36f600ab557a5)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:51.559397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:51.606537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf544717521417db2c36f600ab557a5', 'request_id': 'req-02595e5c-2b9d-409d-9bce-c401e50f60f9'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:51.612438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf544717521417db2c36f600ab557a5', 'request_id': 'req-02595e5c-2b9d-409d-9bce-c401e50f60f9'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:51.618340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf544717521417db2c36f600ab557a5', 'request_id': 'req-02595e5c-2b9d-409d-9bce-c401e50f60f9'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:51.630034 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] The token cache is being invalidate because project 7bf544717521417db2c36f600ab557a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:07:51.630321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:51.630974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-02595e5c-2b9d-409d-9bce-c401e50f60f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:07:51.632541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1035/2071] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:07:51 2022] DELETE /identity/v3/projects/7bf544717521417db2c36f600ab557a5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:51.638712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41de6b8-ec72-4961-bf91-b60c75d95927 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:51.639006 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41de6b8-ec72-4961-bf91-b60c75d95927 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:51.639282 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41de6b8-ec72-4961-bf91-b60c75d95927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:51.657445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f41de6b8-ec72-4961-bf91-b60c75d95927 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:51.658618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f41de6b8-ec72-4961-bf91-b60c75d95927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:51.723889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1037/2072] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:51.732006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57371f-b0e0-4cd5-9da2-e5da2b8e6295 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:51.732792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57371f-b0e0-4cd5-9da2-e5da2b8e6295 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:51.732792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57371f-b0e0-4cd5-9da2-e5da2b8e6295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:51.753611 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-0f57371f-b0e0-4cd5-9da2-e5da2b8e6295 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:51.754914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0f57371f-b0e0-4cd5-9da2-e5da2b8e6295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:51.764199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1036/2073] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:07:51.768641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41de6b8-ec72-4961-bf91-b60c75d95927 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:51.779282 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41de6b8-ec72-4961-bf91-b60c75d95927 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:51.784274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c875e3-2667-4535-b220-9bb6f6fdf814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:51.784931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c875e3-2667-4535-b220-9bb6f6fdf814 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:51.785218 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c875e3-2667-4535-b220-9bb6f6fdf814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:51.785495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c875e3-2667-4535-b220-9bb6f6fdf814 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:51.786219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c875e3-2667-4535-b220-9bb6f6fdf814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:07:51.786533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c875e3-2667-4535-b220-9bb6f6fdf814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:51.788279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c875e3-2667-4535-b220-9bb6f6fdf814 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:51.802657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1038/2074] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:07:51.808085 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57371f-b0e0-4cd5-9da2-e5da2b8e6295 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:51.818247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57371f-b0e0-4cd5-9da2-e5da2b8e6295 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:51.826303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e32ac-a69d-453f-9fac-750baf0c0f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:51.827399 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e32ac-a69d-453f-9fac-750baf0c0f6f admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:51.827727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e32ac-a69d-453f-9fac-750baf0c0f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:51.828007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e32ac-a69d-453f-9fac-750baf0c0f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:51.828800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e32ac-a69d-453f-9fac-750baf0c0f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:51.830758 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e32ac-a69d-453f-9fac-750baf0c0f6f admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:51.856342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1037/2075] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:07:51 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:51.860450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c875e3-2667-4535-b220-9bb6f6fdf814 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:51.871849 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c875e3-2667-4535-b220-9bb6f6fdf814 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:51.942515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fc33f-d57f-4fbf-978e-ddd8c6854fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:51.943181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fc33f-d57f-4fbf-978e-ddd8c6854fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:51.944704 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fc33f-d57f-4fbf-978e-ddd8c6854fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:51.944987 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fc33f-d57f-4fbf-978e-ddd8c6854fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:51.945980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fc33f-d57f-4fbf-978e-ddd8c6854fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:51.947758 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fc33f-d57f-4fbf-978e-ddd8c6854fb3 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:51.981619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1039/2076] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:07:51 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:07:51.986889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e32ac-a69d-453f-9fac-750baf0c0f6f admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:51.995537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e32ac-a69d-453f-9fac-750baf0c0f6f admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:52.000364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40b5bc-865c-4d6c-a04b-c69faca46f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:52.001055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40b5bc-865c-4d6c-a04b-c69faca46f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:52.001340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40b5bc-865c-4d6c-a04b-c69faca46f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:52.001616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40b5bc-865c-4d6c-a04b-c69faca46f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:52.002341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40b5bc-865c-4d6c-a04b-c69faca46f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:52.004027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40b5bc-865c-4d6c-a04b-c69faca46f4b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:52.014729 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1038/2077] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:07:52.019065 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fc33f-d57f-4fbf-978e-ddd8c6854fb3 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:52.029652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fc33f-d57f-4fbf-978e-ddd8c6854fb3 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:52.034525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4942b-bf57-4dae-9e21-1b09f11565df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:52.035312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4942b-bf57-4dae-9e21-1b09f11565df admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:52.035625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4942b-bf57-4dae-9e21-1b09f11565df admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:52.035918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4942b-bf57-4dae-9e21-1b09f11565df admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:52.036719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4942b-bf57-4dae-9e21-1b09f11565df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:52.038375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4942b-bf57-4dae-9e21-1b09f11565df admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:52.052222 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1040/2078] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:07:52.053886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40b5bc-865c-4d6c-a04b-c69faca46f4b admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:52.064542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40b5bc-865c-4d6c-a04b-c69faca46f4b admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:52.069324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fb94d-6048-4168-a51b-ba35c74b45d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:52.070497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb94d-6048-4168-a51b-ba35c74b45d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:52.070884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb94d-6048-4168-a51b-ba35c74b45d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:52.071280 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb94d-6048-4168-a51b-ba35c74b45d0 admin admin] PATH_INFO: `/v3/projects/6789fcac31a44201b027a36d4b0b5891/users/67bc55a81b434387a313df9c6e2e2298/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:52.087183 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fb94d-6048-4168-a51b-ba35c74b45d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6789fcac31a44201b027a36d4b0b5891, user_id=67bc55a81b434387a313df9c6e2e2298, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:52.090030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fb94d-6048-4168-a51b-ba35c74b45d0 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:52.105004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1039/2079] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:07:52 2022] PUT /identity/v3/projects/6789fcac31a44201b027a36d4b0b5891/users/67bc55a81b434387a313df9c6e2e2298/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:07:52.115044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e0f8-6f1c-4955-981f-dad48b67c596 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:52.115335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e0f8-6f1c-4955-981f-dad48b67c596 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:52.115619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e0f8-6f1c-4955-981f-dad48b67c596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:52.144111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e612e0f8-6f1c-4955-981f-dad48b67c596 None None] MFA Rules not processed for user `67bc55a81b434387a313df9c6e2e2298`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:07:52.145405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e612e0f8-6f1c-4955-981f-dad48b67c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:52.220139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1041/2080] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:07:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:07:52.242016 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fb94d-6048-4168-a51b-ba35c74b45d0 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:07:52.244792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c79fb94d-6048-4168-a51b-ba35c74b45d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:07:52.309363 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fb94d-6048-4168-a51b-ba35c74b45d0 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:07:52.313161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05c416-35b2-4ade-aa15-8a67db3e5cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:07:52.313813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05c416-35b2-4ade-aa15-8a67db3e5cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:07:52.314100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05c416-35b2-4ade-aa15-8a67db3e5cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:07:52.314384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05c416-35b2-4ade-aa15-8a67db3e5cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:07:52.324366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05c416-35b2-4ade-aa15-8a67db3e5cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:07:52.324720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05c416-35b2-4ade-aa15-8a67db3e5cc8 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:07:52.333543 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1040/2081] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:07:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:08:01.841099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612e0f8-6f1c-4955-981f-dad48b67c596 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:01.895234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05c416-35b2-4ade-aa15-8a67db3e5cc8 service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:01.897470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-af05c416-35b2-4ade-aa15-8a67db3e5cc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:01.916759 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612e0f8-6f1c-4955-981f-dad48b67c596 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:01.922234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b097d-f5d4-4243-a7cd-ccc6bea91f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:01.923369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b097d-f5d4-4243-a7cd-ccc6bea91f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:01.923690 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b097d-f5d4-4243-a7cd-ccc6bea91f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:01.923967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b097d-f5d4-4243-a7cd-ccc6bea91f96 admin admin] PATH_INFO: `/v3/users/67bc55a81b434387a313df9c6e2e2298` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:01.925225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b097d-f5d4-4243-a7cd-ccc6bea91f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bc55a81b434387a313df9c6e2e2298)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:01.927181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b097d-f5d4-4243-a7cd-ccc6bea91f96 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:01.985988 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-766b097d-f5d4-4243-a7cd-ccc6bea91f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bc55a81b434387a313df9c6e2e2298'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:01.989769 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05c416-35b2-4ade-aa15-8a67db3e5cc8 service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:01.994670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-766b097d-f5d4-4243-a7cd-ccc6bea91f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bc55a81b434387a313df9c6e2e2298'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.000959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab0b67-dd1d-4523-987f-61925723a5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:02.001879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab0b67-dd1d-4523-987f-61925723a5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:02.002241 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab0b67-dd1d-4523-987f-61925723a5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:02.002441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab0b67-dd1d-4523-987f-61925723a5bd admin admin] PATH_INFO: `/v3/users/508be73ddefa4429888114092480bf5f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:02.002885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-766b097d-f5d4-4243-a7cd-ccc6bea91f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bc55a81b434387a313df9c6e2e2298'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.003509 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-766b097d-f5d4-4243-a7cd-ccc6bea91f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bc55a81b434387a313df9c6e2e2298'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.003976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab0b67-dd1d-4523-987f-61925723a5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=508be73ddefa4429888114092480bf5f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:02.004669 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-766b097d-f5d4-4243-a7cd-ccc6bea91f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bc55a81b434387a313df9c6e2e2298'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.006010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab0b67-dd1d-4523-987f-61925723a5bd admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:02.023183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1042/2082] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:08:01 2022] DELETE /identity/v3/users/67bc55a81b434387a313df9c6e2e2298 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:02.029625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351347-bb46-4fdc-afec-adfe16d7cb70 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:02.030075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351347-bb46-4fdc-afec-adfe16d7cb70 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:02.030514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351347-bb46-4fdc-afec-adfe16d7cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:02.049136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-02351347-bb46-4fdc-afec-adfe16d7cb70 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:02.050399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-02351347-bb46-4fdc-afec-adfe16d7cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:02.063691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2eab0b67-dd1d-4523-987f-61925723a5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '508be73ddefa4429888114092480bf5f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.064389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2eab0b67-dd1d-4523-987f-61925723a5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '508be73ddefa4429888114092480bf5f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.073612 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2eab0b67-dd1d-4523-987f-61925723a5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '508be73ddefa4429888114092480bf5f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.082785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2eab0b67-dd1d-4523-987f-61925723a5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '508be73ddefa4429888114092480bf5f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.083603 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2eab0b67-dd1d-4523-987f-61925723a5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '508be73ddefa4429888114092480bf5f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.101830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1041/2083] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:08:01 2022] DELETE /identity/v3/users/508be73ddefa4429888114092480bf5f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:08:02.105966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16ea21-56c2-4480-915c-8f234b397aa8 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:02.106255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16ea21-56c2-4480-915c-8f234b397aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:02.106525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16ea21-56c2-4480-915c-8f234b397aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:02.112972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1043/2084] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:02.123826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02351347-bb46-4fdc-afec-adfe16d7cb70 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:02.125323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-02351347-bb46-4fdc-afec-adfe16d7cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:02.125977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-fc16ea21-56c2-4480-915c-8f234b397aa8 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:02.127220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-fc16ea21-56c2-4480-915c-8f234b397aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:02.180362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02351347-bb46-4fdc-afec-adfe16d7cb70 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:02.186281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1042/2085] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:02.195832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16ea21-56c2-4480-915c-8f234b397aa8 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:02.235696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522f4d4-b6fa-4072-9622-0f14000227df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:02.238749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522f4d4-b6fa-4072-9622-0f14000227df service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:02.238749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522f4d4-b6fa-4072-9622-0f14000227df service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:02.238749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522f4d4-b6fa-4072-9622-0f14000227df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:02.247664 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522f4d4-b6fa-4072-9622-0f14000227df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:02.249135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522f4d4-b6fa-4072-9622-0f14000227df service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:02.250481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16ea21-56c2-4480-915c-8f234b397aa8 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:02.254101 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78882a2-0e2a-4bb3-89ad-4c1a5cc2d58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:02.254739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78882a2-0e2a-4bb3-89ad-4c1a5cc2d58e service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:02.255020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78882a2-0e2a-4bb3-89ad-4c1a5cc2d58e service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:02.255291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78882a2-0e2a-4bb3-89ad-4c1a5cc2d58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:02.258838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1044/2086] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:08:02.265187 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78882a2-0e2a-4bb3-89ad-4c1a5cc2d58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:02.266642 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78882a2-0e2a-4bb3-89ad-4c1a5cc2d58e service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:02.276748 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1043/2087] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:08:02.704378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522f4d4-b6fa-4072-9622-0f14000227df service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:02.704378 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4522f4d4-b6fa-4072-9622-0f14000227df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:02.722361 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78882a2-0e2a-4bb3-89ad-4c1a5cc2d58e service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:02.723803 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f78882a2-0e2a-4bb3-89ad-4c1a5cc2d58e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:02.741056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78882a2-0e2a-4bb3-89ad-4c1a5cc2d58e service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:02.748144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522f4d4-b6fa-4072-9622-0f14000227df service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:02.751917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:02.753247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:02.753883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:02.754353 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] PATH_INFO: `/v3/projects/97511db3040c4ee8ba85614ef5eccd3f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:02.757283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97511db3040c4ee8ba85614ef5eccd3f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:02.759581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:02.760341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:02.761366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:02.761947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:02.762561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] PATH_INFO: `/v3/projects/6789fcac31a44201b027a36d4b0b5891` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:02.764159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6789fcac31a44201b027a36d4b0b5891)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:02.767056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:02.828070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97511db3040c4ee8ba85614ef5eccd3f', 'request_id': 'req-996a6bba-b546-434a-a230-3fe6ad680ae8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.834631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97511db3040c4ee8ba85614ef5eccd3f', 'request_id': 'req-996a6bba-b546-434a-a230-3fe6ad680ae8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.835010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6789fcac31a44201b027a36d4b0b5891', 'request_id': 'req-267993e0-a269-40c6-bb84-8371bcc15191'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.842651 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97511db3040c4ee8ba85614ef5eccd3f', 'request_id': 'req-996a6bba-b546-434a-a230-3fe6ad680ae8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.846642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6789fcac31a44201b027a36d4b0b5891', 'request_id': 'req-267993e0-a269-40c6-bb84-8371bcc15191'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.855785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6789fcac31a44201b027a36d4b0b5891', 'request_id': 'req-267993e0-a269-40c6-bb84-8371bcc15191'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.858476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] The token cache is being invalidate because project 97511db3040c4ee8ba85614ef5eccd3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:08:02.858821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.859610 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-996a6bba-b546-434a-a230-3fe6ad680ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.861588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1044/2088] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:08:02 2022] DELETE /identity/v3/projects/97511db3040c4ee8ba85614ef5eccd3f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:02.866636 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab30c-4853-4289-8df5-fdf9bdf3aed7 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:02.866862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] The token cache is being invalidate because project 6789fcac31a44201b027a36d4b0b5891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:08:02.867108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab30c-4853-4289-8df5-fdf9bdf3aed7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:02.867210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.867493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab30c-4853-4289-8df5-fdf9bdf3aed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:02.868289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-267993e0-a269-40c6-bb84-8371bcc15191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:02.870183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1045/2089] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:08:02 2022] DELETE /identity/v3/projects/6789fcac31a44201b027a36d4b0b5891 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:02.875283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f89bb7-9ad2-47c5-a666-f536d34199c3 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:02.876007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f89bb7-9ad2-47c5-a666-f536d34199c3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:02.876685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f89bb7-9ad2-47c5-a666-f536d34199c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:02.891142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-0e5ab30c-4853-4289-8df5-fdf9bdf3aed7 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:02.892393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0e5ab30c-4853-4289-8df5-fdf9bdf3aed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:02.895974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-64f89bb7-9ad2-47c5-a666-f536d34199c3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:02.897161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-64f89bb7-9ad2-47c5-a666-f536d34199c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:02.952291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1045/2090] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:08:02.957508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1046/2091] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:08:02.964107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811e696-6fda-4fca-8047-cf7e8fa2d67c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:02.964577 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811e696-6fda-4fca-8047-cf7e8fa2d67c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:02.964869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811e696-6fda-4fca-8047-cf7e8fa2d67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:02.966163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79edf0-cbbc-468c-b1cc-4cb919d22da9 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:02.966456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79edf0-cbbc-468c-b1cc-4cb919d22da9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:02.966735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79edf0-cbbc-468c-b1cc-4cb919d22da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:02.984172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-d811e696-6fda-4fca-8047-cf7e8fa2d67c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:02.985399 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-d811e696-6fda-4fca-8047-cf7e8fa2d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:02.985504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-7e79edf0-cbbc-468c-b1cc-4cb919d22da9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:02.986625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-7e79edf0-cbbc-468c-b1cc-4cb919d22da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:02.993432 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1046/2092] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:02.995115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1047/2093] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:08:02.997941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811e696-6fda-4fca-8047-cf7e8fa2d67c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:02.999122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79edf0-cbbc-468c-b1cc-4cb919d22da9 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.008794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79edf0-cbbc-468c-b1cc-4cb919d22da9 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.011527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811e696-6fda-4fca-8047-cf7e8fa2d67c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.014133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5722fd3-da75-4ea2-9143-85afd75fe1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.014798 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722fd3-da75-4ea2-9143-85afd75fe1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.015079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722fd3-da75-4ea2-9143-85afd75fe1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.015358 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722fd3-da75-4ea2-9143-85afd75fe1c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.016094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5722fd3-da75-4ea2-9143-85afd75fe1c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:08:03.016288 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c412c1-58d0-47ab-b980-db4642823b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.016531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5722fd3-da75-4ea2-9143-85afd75fe1c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.017100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c412c1-58d0-47ab-b980-db4642823b6b admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.017386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c412c1-58d0-47ab-b980-db4642823b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.017662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c412c1-58d0-47ab-b980-db4642823b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.018131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5722fd3-da75-4ea2-9143-85afd75fe1c1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.018388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c412c1-58d0-47ab-b980-db4642823b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:08:03.018694 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c412c1-58d0-47ab-b980-db4642823b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.020321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c412c1-58d0-47ab-b980-db4642823b6b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.030000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1048/2094] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:08:03.034212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5722fd3-da75-4ea2-9143-85afd75fe1c1 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.036443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1047/2095] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:08:03.038650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c412c1-58d0-47ab-b980-db4642823b6b admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.044573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5722fd3-da75-4ea2-9143-85afd75fe1c1 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.052513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6c19c-656b-4ee1-8df1-8c4f15be30b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.052878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c412c1-58d0-47ab-b980-db4642823b6b admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.053812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6c19c-656b-4ee1-8df1-8c4f15be30b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.053812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6c19c-656b-4ee1-8df1-8c4f15be30b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.054269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6c19c-656b-4ee1-8df1-8c4f15be30b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.055028 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6c19c-656b-4ee1-8df1-8c4f15be30b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.060308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6c19c-656b-4ee1-8df1-8c4f15be30b4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.063907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e7d24-d86e-4659-b0d1-c9973c5c2c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.064632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e7d24-d86e-4659-b0d1-c9973c5c2c56 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.064920 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e7d24-d86e-4659-b0d1-c9973c5c2c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.065199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e7d24-d86e-4659-b0d1-c9973c5c2c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.065900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e7d24-d86e-4659-b0d1-c9973c5c2c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.067814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e7d24-d86e-4659-b0d1-c9973c5c2c56 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.094268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1049/2096] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:08:03 2022] POST /identity/v3/projects => generated 359 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:08:03.098406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6c19c-656b-4ee1-8df1-8c4f15be30b4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.102581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1048/2097] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:08:03 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:08:03.104450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e7d24-d86e-4659-b0d1-c9973c5c2c56 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.168212 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6c19c-656b-4ee1-8df1-8c4f15be30b4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.177861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e7d24-d86e-4659-b0d1-c9973c5c2c56 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.178260 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ce3f0-26c0-4ab2-9f77-7c671fcf946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.179257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce3f0-26c0-4ab2-9f77-7c671fcf946b admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.179541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce3f0-26c0-4ab2-9f77-7c671fcf946b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.179884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ce3f0-26c0-4ab2-9f77-7c671fcf946b admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.180842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ce3f0-26c0-4ab2-9f77-7c671fcf946b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.183534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ce3f0-26c0-4ab2-9f77-7c671fcf946b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.183928 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685d1a3-9942-4828-b60b-d499fb2bf560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.184704 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d1a3-9942-4828-b60b-d499fb2bf560 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.185067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d1a3-9942-4828-b60b-d499fb2bf560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.185426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685d1a3-9942-4828-b60b-d499fb2bf560 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.186192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685d1a3-9942-4828-b60b-d499fb2bf560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.188204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685d1a3-9942-4828-b60b-d499fb2bf560 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.211312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1050/2098] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:08:03 2022] POST /identity/v3/users => generated 280 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:08:03.212719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ce3f0-26c0-4ab2-9f77-7c671fcf946b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.216851 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1049/2099] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:08:03 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:08:03.217875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685d1a3-9942-4828-b60b-d499fb2bf560 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.223977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ce3f0-26c0-4ab2-9f77-7c671fcf946b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.231151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685d1a3-9942-4828-b60b-d499fb2bf560 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.232957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd174e7-79e4-4264-83ef-4de56a1a8300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.233709 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd174e7-79e4-4264-83ef-4de56a1a8300 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.234064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd174e7-79e4-4264-83ef-4de56a1a8300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.234421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd174e7-79e4-4264-83ef-4de56a1a8300 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.235234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd174e7-79e4-4264-83ef-4de56a1a8300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.236035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbb135-24b0-4993-936a-3f6c1f48b53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.236795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbb135-24b0-4993-936a-3f6c1f48b53d admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.237096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbb135-24b0-4993-936a-3f6c1f48b53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.237188 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd174e7-79e4-4264-83ef-4de56a1a8300 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.237491 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbb135-24b0-4993-936a-3f6c1f48b53d admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.238222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbb135-24b0-4993-936a-3f6c1f48b53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.239805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbb135-24b0-4993-936a-3f6c1f48b53d admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.248225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1051/2100] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:08:03.251231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1050/2101] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:08:03.252074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd174e7-79e4-4264-83ef-4de56a1a8300 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.254912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbb135-24b0-4993-936a-3f6c1f48b53d admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.261843 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd174e7-79e4-4264-83ef-4de56a1a8300 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.264834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbb135-24b0-4993-936a-3f6c1f48b53d admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.266505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff488a2-9f4b-459a-b27f-1343af038da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.267117 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff488a2-9f4b-459a-b27f-1343af038da9 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.267398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff488a2-9f4b-459a-b27f-1343af038da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.267679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff488a2-9f4b-459a-b27f-1343af038da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.268416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff488a2-9f4b-459a-b27f-1343af038da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.269796 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa5a4b-f31b-46c7-91d4-8e3af08bd663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.269987 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff488a2-9f4b-459a-b27f-1343af038da9 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.270435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5a4b-f31b-46c7-91d4-8e3af08bd663 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.270721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5a4b-f31b-46c7-91d4-8e3af08bd663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.270997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa5a4b-f31b-46c7-91d4-8e3af08bd663 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.271733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa5a4b-f31b-46c7-91d4-8e3af08bd663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.273340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa5a4b-f31b-46c7-91d4-8e3af08bd663 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.280454 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1052/2102] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:08:03.287151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1051/2103] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:08:03.288479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff488a2-9f4b-459a-b27f-1343af038da9 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.289109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa5a4b-f31b-46c7-91d4-8e3af08bd663 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.299566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff488a2-9f4b-459a-b27f-1343af038da9 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.300720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa5a4b-f31b-46c7-91d4-8e3af08bd663 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.304419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95622986-1a98-48b6-a3c1-543b01fc5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.305370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716b9af-421c-4f3e-b8c7-ac2ee3b762f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.305492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95622986-1a98-48b6-a3c1-543b01fc5045 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.305822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95622986-1a98-48b6-a3c1-543b01fc5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.306780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95622986-1a98-48b6-a3c1-543b01fc5045 admin admin] PATH_INFO: `/v3/projects/a69c8441974b4749bd43a2ccf3629332/users/f45cfe92bd7641b6b78b99938767bc32/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.306892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716b9af-421c-4f3e-b8c7-ac2ee3b762f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.307135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716b9af-421c-4f3e-b8c7-ac2ee3b762f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.307469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716b9af-421c-4f3e-b8c7-ac2ee3b762f1 admin admin] PATH_INFO: `/v3/projects/6728a505fac4403382182ee56cecaef0/users/8eaf352cc3e4415786906ddc9bfb6c41/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.322992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716b9af-421c-4f3e-b8c7-ac2ee3b762f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6728a505fac4403382182ee56cecaef0, user_id=8eaf352cc3e4415786906ddc9bfb6c41, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.323205 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95622986-1a98-48b6-a3c1-543b01fc5045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69c8441974b4749bd43a2ccf3629332, user_id=f45cfe92bd7641b6b78b99938767bc32, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.326002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716b9af-421c-4f3e-b8c7-ac2ee3b762f1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.326152 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95622986-1a98-48b6-a3c1-543b01fc5045 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.340025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1053/2104] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:08:03 2022] PUT /identity/v3/projects/a69c8441974b4749bd43a2ccf3629332/users/f45cfe92bd7641b6b78b99938767bc32/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:03.340279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1052/2105] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:08:03 2022] PUT /identity/v3/projects/6728a505fac4403382182ee56cecaef0/users/8eaf352cc3e4415786906ddc9bfb6c41/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:03.345183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0392ae6-f74b-422a-a9c8-4a6976d68607 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.345472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0392ae6-f74b-422a-a9c8-4a6976d68607 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.345741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0392ae6-f74b-422a-a9c8-4a6976d68607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.350241 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4615c7-f8c1-47fa-86f8-b65384fac83b None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.350527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4615c7-f8c1-47fa-86f8-b65384fac83b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.350808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4615c7-f8c1-47fa-86f8-b65384fac83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.366375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-c0392ae6-f74b-422a-a9c8-4a6976d68607 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:03.367568 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c0392ae6-f74b-422a-a9c8-4a6976d68607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:03.377825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-6d4615c7-f8c1-47fa-86f8-b65384fac83b None None] MFA Rules not processed for user `8eaf352cc3e4415786906ddc9bfb6c41`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:03.379041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6d4615c7-f8c1-47fa-86f8-b65384fac83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:03.429258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1054/2106] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:03.439920 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0392ae6-f74b-422a-a9c8-4a6976d68607 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.441311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c0392ae6-f74b-422a-a9c8-4a6976d68607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:03.445420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1053/2107] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:08:03.477780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4615c7-f8c1-47fa-86f8-b65384fac83b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.484353 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6d4615c7-f8c1-47fa-86f8-b65384fac83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:03.509995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0392ae6-f74b-422a-a9c8-4a6976d68607 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.513702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70c62-9228-419f-aa0d-78cbf2065178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.514345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70c62-9228-419f-aa0d-78cbf2065178 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.514626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70c62-9228-419f-aa0d-78cbf2065178 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.514901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70c62-9228-419f-aa0d-78cbf2065178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.523954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70c62-9228-419f-aa0d-78cbf2065178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.525918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70c62-9228-419f-aa0d-78cbf2065178 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.535890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1055/2108] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:08:03.550213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4615c7-f8c1-47fa-86f8-b65384fac83b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.554533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175998e4-bc19-4cf0-b783-9fd195cd6531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.555197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175998e4-bc19-4cf0-b783-9fd195cd6531 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.555478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175998e4-bc19-4cf0-b783-9fd195cd6531 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.555752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175998e4-bc19-4cf0-b783-9fd195cd6531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.565191 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175998e4-bc19-4cf0-b783-9fd195cd6531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.566648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175998e4-bc19-4cf0-b783-9fd195cd6531 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.576619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1054/2109] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:03 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:08:03.592647 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70c62-9228-419f-aa0d-78cbf2065178 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.602407 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70c62-9228-419f-aa0d-78cbf2065178 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.608117 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.609037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.609316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.609590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] PATH_INFO: `/v3/users/8eaf352cc3e4415786906ddc9bfb6c41` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.610798 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eaf352cc3e4415786906ddc9bfb6c41)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.612818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.663793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eaf352cc3e4415786906ddc9bfb6c41'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:03.672404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eaf352cc3e4415786906ddc9bfb6c41'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:03.681609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eaf352cc3e4415786906ddc9bfb6c41'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:03.682475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eaf352cc3e4415786906ddc9bfb6c41'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:03.683337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eaf352cc3e4415786906ddc9bfb6c41'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:03.704553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1056/2110] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:08:03 2022] DELETE /identity/v3/users/8eaf352cc3e4415786906ddc9bfb6c41 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:03.710275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4e45-f6a8-4e57-b6b0-fac2f2823f4c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.710688 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4e45-f6a8-4e57-b6b0-fac2f2823f4c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.711070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4e45-f6a8-4e57-b6b0-fac2f2823f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.742652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-0ffe4e45-f6a8-4e57-b6b0-fac2f2823f4c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:03.744378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0ffe4e45-f6a8-4e57-b6b0-fac2f2823f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:03.829524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1055/2111] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:03.855202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:03.856844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:03.943101 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75897aa7-a489-4be1-be6f-e114aaf971ca admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:03.955443 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c890d20-0dfc-4fb7-9832-ce52b5ac3746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:03.956889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890d20-0dfc-4fb7-9832-ce52b5ac3746 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:03.957244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890d20-0dfc-4fb7-9832-ce52b5ac3746 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:03.957586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c890d20-0dfc-4fb7-9832-ce52b5ac3746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:03.974652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c890d20-0dfc-4fb7-9832-ce52b5ac3746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:03.976423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c890d20-0dfc-4fb7-9832-ce52b5ac3746 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:03.994982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1057/2112] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:08:04.519809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe4e45-f6a8-4e57-b6b0-fac2f2823f4c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:04.519809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0ffe4e45-f6a8-4e57-b6b0-fac2f2823f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:04.521437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa8983-6c67-4876-8ad5-0e42ae3e8273 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:04.521648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa8983-6c67-4876-8ad5-0e42ae3e8273 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:04.522039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa8983-6c67-4876-8ad5-0e42ae3e8273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:04.536560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe4e45-f6a8-4e57-b6b0-fac2f2823f4c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:04.543276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:04.545400 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:04.545825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:04.546672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] PATH_INFO: `/v3/projects/6728a505fac4403382182ee56cecaef0` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:04.548206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6728a505fac4403382182ee56cecaef0)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:04.550379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:04.562676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4caa8983-6c67-4876-8ad5-0e42ae3e8273 None None] MFA Rules not processed for user `f45cfe92bd7641b6b78b99938767bc32`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:04.565038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4caa8983-6c67-4876-8ad5-0e42ae3e8273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:04.617224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6728a505fac4403382182ee56cecaef0', 'request_id': 'req-a8090565-a535-43e5-ae41-bcc4259940d4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:04.624520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6728a505fac4403382182ee56cecaef0', 'request_id': 'req-a8090565-a535-43e5-ae41-bcc4259940d4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:04.633947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6728a505fac4403382182ee56cecaef0', 'request_id': 'req-a8090565-a535-43e5-ae41-bcc4259940d4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:04.642768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1058/2113] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:04.653038 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] The token cache is being invalidate because project 6728a505fac4403382182ee56cecaef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:08:04.653716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:04.654584 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a8090565-a535-43e5-ae41-bcc4259940d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:04.656874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1056/2114] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:08:04 2022] DELETE /identity/v3/projects/6728a505fac4403382182ee56cecaef0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:08:04.657490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa8983-6c67-4876-8ad5-0e42ae3e8273 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:04.659131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4caa8983-6c67-4876-8ad5-0e42ae3e8273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:04.661569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c4871-c77a-4560-b42f-c1a933ecf971 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:04.662264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c4871-c77a-4560-b42f-c1a933ecf971 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:04.662541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c4871-c77a-4560-b42f-c1a933ecf971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:04.682943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-4c9c4871-c77a-4560-b42f-c1a933ecf971 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:04.684259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4c9c4871-c77a-4560-b42f-c1a933ecf971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:04.732396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa8983-6c67-4876-8ad5-0e42ae3e8273 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:04.750672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1057/2115] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:08:04.758077 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938a0b-01ea-48e0-949e-74a421c2e022 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:04.758365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938a0b-01ea-48e0-949e-74a421c2e022 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:04.758641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f938a0b-01ea-48e0-949e-74a421c2e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:04.776304 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-3f938a0b-01ea-48e0-949e-74a421c2e022 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:04.777494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3f938a0b-01ea-48e0-949e-74a421c2e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:04.784153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01868-3c23-4c21-80a3-ceffeecc9a1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:04.784860 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01868-3c23-4c21-80a3-ceffeecc9a1c service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:04.785112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01868-3c23-4c21-80a3-ceffeecc9a1c service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:04.785387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01868-3c23-4c21-80a3-ceffeecc9a1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:04.787171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-00b01868-3c23-4c21-80a3-ceffeecc9a1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:04.787437 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1058/2116] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:08:04.792166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f938a0b-01ea-48e0-949e-74a421c2e022 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:04.801278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f938a0b-01ea-48e0-949e-74a421c2e022 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:04.807330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6066e-5afa-4808-8843-38d120b2bb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:04.808122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6066e-5afa-4808-8843-38d120b2bb27 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:04.808439 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6066e-5afa-4808-8843-38d120b2bb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:04.808714 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6066e-5afa-4808-8843-38d120b2bb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:04.809445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6066e-5afa-4808-8843-38d120b2bb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:08:04.809751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6066e-5afa-4808-8843-38d120b2bb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:04.811364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6066e-5afa-4808-8843-38d120b2bb27 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:04.823495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1059/2117] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:08:04.827947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6066e-5afa-4808-8843-38d120b2bb27 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:04.837713 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6066e-5afa-4808-8843-38d120b2bb27 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:04.842616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f985ca-db08-4e44-a946-328f4ade53dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:04.843262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f985ca-db08-4e44-a946-328f4ade53dc admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:04.843543 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f985ca-db08-4e44-a946-328f4ade53dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:04.843816 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f985ca-db08-4e44-a946-328f4ade53dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:04.844530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f985ca-db08-4e44-a946-328f4ade53dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:04.846543 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f985ca-db08-4e44-a946-328f4ade53dc admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:04.846791 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b01868-3c23-4c21-80a3-ceffeecc9a1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:04.848315 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b01868-3c23-4c21-80a3-ceffeecc9a1c service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:04.859208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1059/2118] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:08:04.875903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1060/2119] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:08:04 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:08:04.877011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01868-3c23-4c21-80a3-ceffeecc9a1c service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:04.888504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01868-3c23-4c21-80a3-ceffeecc9a1c service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:04.948874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fc126-5425-403b-8551-aaf189381448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:04.949246 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fc126-5425-403b-8551-aaf189381448 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:04.949530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fc126-5425-403b-8551-aaf189381448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:04.949804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fc126-5425-403b-8551-aaf189381448 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:04.950492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fc126-5425-403b-8551-aaf189381448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:04.952419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fc126-5425-403b-8551-aaf189381448 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:04.978630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1060/2120] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:08:04 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:08:04.982693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f985ca-db08-4e44-a946-328f4ade53dc admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:04.993138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f985ca-db08-4e44-a946-328f4ade53dc admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:04.998537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f73e51-c303-49b7-8761-c6ca586cf961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:04.999203 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f73e51-c303-49b7-8761-c6ca586cf961 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:04.999490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f73e51-c303-49b7-8761-c6ca586cf961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:04.999775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f73e51-c303-49b7-8761-c6ca586cf961 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:05.000559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f73e51-c303-49b7-8761-c6ca586cf961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:05.002205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f73e51-c303-49b7-8761-c6ca586cf961 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:05.012164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1061/2121] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:08:05.016325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fc126-5425-403b-8551-aaf189381448 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:05.028253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fc126-5425-403b-8551-aaf189381448 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:05.033132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae6e7d-3e6a-42a9-8bd5-d4e48b093471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:05.033794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae6e7d-3e6a-42a9-8bd5-d4e48b093471 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:05.034097 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae6e7d-3e6a-42a9-8bd5-d4e48b093471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:05.034358 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae6e7d-3e6a-42a9-8bd5-d4e48b093471 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:05.035209 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae6e7d-3e6a-42a9-8bd5-d4e48b093471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:05.036856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae6e7d-3e6a-42a9-8bd5-d4e48b093471 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:05.048208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1061/2122] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:08:05.052762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f73e51-c303-49b7-8761-c6ca586cf961 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:05.064254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f73e51-c303-49b7-8761-c6ca586cf961 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:05.068882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40015825-21fa-4f1a-9458-9eb8076c313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:05.070010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40015825-21fa-4f1a-9458-9eb8076c313b admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:05.070294 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40015825-21fa-4f1a-9458-9eb8076c313b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:05.070575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40015825-21fa-4f1a-9458-9eb8076c313b admin admin] PATH_INFO: `/v3/projects/76b64f5e92ae4a0a9f756026c2e398af/users/7330cf580a8644d28bfca1eb4cb75fb4/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:05.087043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40015825-21fa-4f1a-9458-9eb8076c313b admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b64f5e92ae4a0a9f756026c2e398af, user_id=7330cf580a8644d28bfca1eb4cb75fb4, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:05.090243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40015825-21fa-4f1a-9458-9eb8076c313b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:05.103427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1062/2123] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:08:05 2022] PUT /identity/v3/projects/76b64f5e92ae4a0a9f756026c2e398af/users/7330cf580a8644d28bfca1eb4cb75fb4/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:05.108571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99cd84-a9df-4f8d-a0e9-56d78f10013d None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:05.108867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99cd84-a9df-4f8d-a0e9-56d78f10013d None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:05.109154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99cd84-a9df-4f8d-a0e9-56d78f10013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:05.129121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4c99cd84-a9df-4f8d-a0e9-56d78f10013d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:05.144395 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4c99cd84-a9df-4f8d-a0e9-56d78f10013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:05.225265 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1062/2124] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:08:05.237605 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40015825-21fa-4f1a-9458-9eb8076c313b admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:05.238110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-40015825-21fa-4f1a-9458-9eb8076c313b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:05.299179 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40015825-21fa-4f1a-9458-9eb8076c313b admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:05.302786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca380b-2b79-44df-bf8c-979b00a3e6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:05.303424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca380b-2b79-44df-bf8c-979b00a3e6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:05.303705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca380b-2b79-44df-bf8c-979b00a3e6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:05.303979 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca380b-2b79-44df-bf8c-979b00a3e6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:05.313246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca380b-2b79-44df-bf8c-979b00a3e6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:05.314661 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca380b-2b79-44df-bf8c-979b00a3e6d9 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:05.324734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1063/2125] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:08:06.268788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9411-939e-4a5b-b71d-6ce050a8829c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:06.269379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9411-939e-4a5b-b71d-6ce050a8829c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:06.269379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef9411-939e-4a5b-b71d-6ce050a8829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:06.307728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-45ef9411-939e-4a5b-b71d-6ce050a8829c None None] MFA Rules not processed for user `f45cfe92bd7641b6b78b99938767bc32`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:06.309267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-45ef9411-939e-4a5b-b71d-6ce050a8829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:06.386179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1063/2126] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:10.075915 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6820887-e132-4d10-a988-2829e83e546a None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:10.076370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6820887-e132-4d10-a988-2829e83e546a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:10.076525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6820887-e132-4d10-a988-2829e83e546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:10.106774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a6820887-e132-4d10-a988-2829e83e546a None None] MFA Rules not processed for user `7330cf580a8644d28bfca1eb4cb75fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:10.108736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a6820887-e132-4d10-a988-2829e83e546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:10.175315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1064/2127] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:10.179743 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef9411-939e-4a5b-b71d-6ce050a8829c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:10.191164 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef9411-939e-4a5b-b71d-6ce050a8829c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:10.195869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28264158-0a58-4d34-a28e-f9ab425089c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:10.196729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28264158-0a58-4d34-a28e-f9ab425089c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:10.197210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28264158-0a58-4d34-a28e-f9ab425089c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:10.197491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28264158-0a58-4d34-a28e-f9ab425089c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:10.198313 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28264158-0a58-4d34-a28e-f9ab425089c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:10.200073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28264158-0a58-4d34-a28e-f9ab425089c4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:10.232752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1064/2128] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:08:10 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:08:10.234937 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6820887-e132-4d10-a988-2829e83e546a None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:10.247876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6820887-e132-4d10-a988-2829e83e546a None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:10.304666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b7303-66ef-4270-8b3e-7259972f391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:10.305334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b7303-66ef-4270-8b3e-7259972f391c admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:10.305619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b7303-66ef-4270-8b3e-7259972f391c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:10.305982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b7303-66ef-4270-8b3e-7259972f391c admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:10.306665 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b7303-66ef-4270-8b3e-7259972f391c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:10.308622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b7303-66ef-4270-8b3e-7259972f391c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:10.331348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1065/2129] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:08:10 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:08:10.335385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28264158-0a58-4d34-a28e-f9ab425089c4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:10.346445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28264158-0a58-4d34-a28e-f9ab425089c4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:10.351039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f52171-ad6e-40c4-957b-62409849a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:10.351686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f52171-ad6e-40c4-957b-62409849a104 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:10.352028 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f52171-ad6e-40c4-957b-62409849a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:10.352347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f52171-ad6e-40c4-957b-62409849a104 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:10.355308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f52171-ad6e-40c4-957b-62409849a104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:10.357053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f52171-ad6e-40c4-957b-62409849a104 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:10.368170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1065/2130] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:08:10.372587 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b7303-66ef-4270-8b3e-7259972f391c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:10.382861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b7303-66ef-4270-8b3e-7259972f391c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:10.387952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1852462-07b8-420c-9b95-6dd67e062daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:10.388885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1852462-07b8-420c-9b95-6dd67e062daa admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:10.389170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1852462-07b8-420c-9b95-6dd67e062daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:10.389475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1852462-07b8-420c-9b95-6dd67e062daa admin admin] PATH_INFO: `/v3/projects/8282fdb39f694827b9e9a9f6b320a132/users/7ab5bee6cb1c480a84d3a0399854b1b3/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:10.409522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1852462-07b8-420c-9b95-6dd67e062daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8282fdb39f694827b9e9a9f6b320a132, user_id=7ab5bee6cb1c480a84d3a0399854b1b3, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:10.413479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1852462-07b8-420c-9b95-6dd67e062daa admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:10.428779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1066/2131] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:08:10 2022] PUT /identity/v3/projects/8282fdb39f694827b9e9a9f6b320a132/users/7ab5bee6cb1c480a84d3a0399854b1b3/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:10.433720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f52171-ad6e-40c4-957b-62409849a104 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:10.444241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f52171-ad6e-40c4-957b-62409849a104 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:10.512167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c8cb-eb17-40d8-9571-11ebf2e23631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:10.512868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c8cb-eb17-40d8-9571-11ebf2e23631 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:10.513149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c8cb-eb17-40d8-9571-11ebf2e23631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:10.513424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c8cb-eb17-40d8-9571-11ebf2e23631 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:10.514144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c8cb-eb17-40d8-9571-11ebf2e23631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:10.516049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c8cb-eb17-40d8-9571-11ebf2e23631 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:10.528220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1066/2132] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:08:10.532405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1852462-07b8-420c-9b95-6dd67e062daa admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:10.546155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1852462-07b8-420c-9b95-6dd67e062daa admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:10.553035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7c7d7-afca-4028-816b-cd277731fd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:10.554293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c7d7-afca-4028-816b-cd277731fd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:10.554748 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c7d7-afca-4028-816b-cd277731fd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:10.555029 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c7d7-afca-4028-816b-cd277731fd00 admin admin] PATH_INFO: `/v3/projects/8282fdb39f694827b9e9a9f6b320a132/users/7ab5bee6cb1c480a84d3a0399854b1b3/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:10.558223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7c7d7-afca-4028-816b-cd277731fd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8282fdb39f694827b9e9a9f6b320a132, user_id=7ab5bee6cb1c480a84d3a0399854b1b3, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:10.560987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7c7d7-afca-4028-816b-cd277731fd00 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:10.573453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1067/2133] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:08:10 2022] PUT /identity/v3/projects/8282fdb39f694827b9e9a9f6b320a132/users/7ab5bee6cb1c480a84d3a0399854b1b3/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:15.356155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ad0c-ce4e-4bab-bcdb-2f59ead646d4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:15.356689 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ad0c-ce4e-4bab-bcdb-2f59ead646d4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:15.356789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ad0c-ce4e-4bab-bcdb-2f59ead646d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:15.386094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-7e84ad0c-ce4e-4bab-bcdb-2f59ead646d4 None None] MFA Rules not processed for user `7ab5bee6cb1c480a84d3a0399854b1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:15.387300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-7e84ad0c-ce4e-4bab-bcdb-2f59ead646d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:15.461205 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1067/2134] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:15 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:15.475243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7c7d7-afca-4028-816b-cd277731fd00 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:15.477098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-30a7c7d7-afca-4028-816b-cd277731fd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:15.556560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7c7d7-afca-4028-816b-cd277731fd00 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:15.562345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8a487-a771-4898-994b-4a3415a44172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:15.563007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8a487-a771-4898-994b-4a3415a44172 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:15.563285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8a487-a771-4898-994b-4a3415a44172 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:15.563556 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8a487-a771-4898-994b-4a3415a44172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:15.627814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8a487-a771-4898-994b-4a3415a44172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:15.629496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8a487-a771-4898-994b-4a3415a44172 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:15.639291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1068/2135] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:08:16.616481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f28b2-b8c5-4b7b-ae9c-98c219554a16 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:16.616977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f28b2-b8c5-4b7b-ae9c-98c219554a16 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:16.617089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f28b2-b8c5-4b7b-ae9c-98c219554a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:16.638178 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-209f28b2-b8c5-4b7b-ae9c-98c219554a16 None None] MFA Rules not processed for user `7330cf580a8644d28bfca1eb4cb75fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:16.639557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-209f28b2-b8c5-4b7b-ae9c-98c219554a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:16.647435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1068/2136] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:40.210199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8a487-a771-4898-994b-4a3415a44172 service nova] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:40.211699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a6e8a487-a771-4898-994b-4a3415a44172 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:40.346333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8a487-a771-4898-994b-4a3415a44172 service nova] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:40.351019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:40.351880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:40.352158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:40.352462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] PATH_INFO: `/v3/users/8097476750db4423bee73f576838227f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:40.354473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8097476750db4423bee73f576838227f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:40.356520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:40.402109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8097476750db4423bee73f576838227f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:40.402757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8097476750db4423bee73f576838227f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:40.409421 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8097476750db4423bee73f576838227f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:40.417000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8097476750db4423bee73f576838227f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:40.417600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8097476750db4423bee73f576838227f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:40.435687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1069/2137] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:08:40 2022] DELETE /identity/v3/users/8097476750db4423bee73f576838227f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:40.440059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21866c3-e902-44fd-8d6f-a53962a45883 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:40.440564 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21866c3-e902-44fd-8d6f-a53962a45883 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:40.440652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21866c3-e902-44fd-8d6f-a53962a45883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:40.467141 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a21866c3-e902-44fd-8d6f-a53962a45883 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:40.468353 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a21866c3-e902-44fd-8d6f-a53962a45883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:40.523142 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1069/2138] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:40.534006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:40.535454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:40.630297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073d913-a529-44ad-bf67-da175230f550 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:40.634099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852b1e3-fc14-4eaf-946d-4a41040b0893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:40.635227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b1e3-fc14-4eaf-946d-4a41040b0893 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:40.635508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b1e3-fc14-4eaf-946d-4a41040b0893 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:40.635784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b1e3-fc14-4eaf-946d-4a41040b0893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:40.644772 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852b1e3-fc14-4eaf-946d-4a41040b0893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:40.646198 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852b1e3-fc14-4eaf-946d-4a41040b0893 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:40.656776 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1070/2139] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:08:40.925385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21866c3-e902-44fd-8d6f-a53962a45883 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:40.926854 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a21866c3-e902-44fd-8d6f-a53962a45883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:40.940409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21866c3-e902-44fd-8d6f-a53962a45883 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:40.945347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:40.946201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:40.946486 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:40.946761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] PATH_INFO: `/v3/projects/4f23f7bdbefa421d862c507e46e9bf87` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:40.948741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f23f7bdbefa421d862c507e46e9bf87)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:40.950688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:41.003569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f23f7bdbefa421d862c507e46e9bf87', 'request_id': 'req-9f9c92c2-987d-4649-95e4-5a562c71e218'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.011543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f23f7bdbefa421d862c507e46e9bf87', 'request_id': 'req-9f9c92c2-987d-4649-95e4-5a562c71e218'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.018088 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f23f7bdbefa421d862c507e46e9bf87', 'request_id': 'req-9f9c92c2-987d-4649-95e4-5a562c71e218'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.028083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] The token cache is being invalidate because project 4f23f7bdbefa421d862c507e46e9bf87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:08:41.028408 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.029081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.030658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1070/2140] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:08:40 2022] DELETE /identity/v3/projects/4f23f7bdbefa421d862c507e46e9bf87 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:41.034714 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852b1e3-fc14-4eaf-946d-4a41040b0893 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:41.044249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852b1e3-fc14-4eaf-946d-4a41040b0893 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:41.099992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57129ff2-7d39-4691-ae74-ce42c714c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:41.100877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57129ff2-7d39-4691-ae74-ce42c714c1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:41.101155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57129ff2-7d39-4691-ae74-ce42c714c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:41.101541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57129ff2-7d39-4691-ae74-ce42c714c1b8 admin admin] PATH_INFO: `/v3/users/f2b95957a5cc473ebeda35f17e729486` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:41.103212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57129ff2-7d39-4691-ae74-ce42c714c1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b95957a5cc473ebeda35f17e729486)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:41.106232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57129ff2-7d39-4691-ae74-ce42c714c1b8 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:41.153450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-57129ff2-7d39-4691-ae74-ce42c714c1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b95957a5cc473ebeda35f17e729486'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.154193 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-57129ff2-7d39-4691-ae74-ce42c714c1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b95957a5cc473ebeda35f17e729486'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.161023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-57129ff2-7d39-4691-ae74-ce42c714c1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b95957a5cc473ebeda35f17e729486'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.168602 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-57129ff2-7d39-4691-ae74-ce42c714c1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b95957a5cc473ebeda35f17e729486'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.169221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-57129ff2-7d39-4691-ae74-ce42c714c1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b95957a5cc473ebeda35f17e729486'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.186819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1071/2141] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:08:41 2022] DELETE /identity/v3/users/f2b95957a5cc473ebeda35f17e729486 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:41.479445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:41.481090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:41.498194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c92c2-987d-4649-95e4-5a562c71e218 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:41.563436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:41.564520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:41.564799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:41.565073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] PATH_INFO: `/v3/projects/88f2034bbf38442ab4ebcf45f3729c23` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:41.566257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f2034bbf38442ab4ebcf45f3729c23)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:41.568356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:41.619621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f2034bbf38442ab4ebcf45f3729c23', 'request_id': 'req-53d964df-7370-4c0b-bd52-a083fe54414f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.625940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f2034bbf38442ab4ebcf45f3729c23', 'request_id': 'req-53d964df-7370-4c0b-bd52-a083fe54414f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.631932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f2034bbf38442ab4ebcf45f3729c23', 'request_id': 'req-53d964df-7370-4c0b-bd52-a083fe54414f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.642466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] The token cache is being invalidate because project 88f2034bbf38442ab4ebcf45f3729c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:08:41.642747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.643366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53d964df-7370-4c0b-bd52-a083fe54414f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:41.644911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1071/2142] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:08:41 2022] DELETE /identity/v3/projects/88f2034bbf38442ab4ebcf45f3729c23 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:41.649727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff368b8-dab3-4eb9-b335-438660d405e0 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:41.650824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff368b8-dab3-4eb9-b335-438660d405e0 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:41.651177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff368b8-dab3-4eb9-b335-438660d405e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:41.698609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-5ff368b8-dab3-4eb9-b335-438660d405e0 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:41.699832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5ff368b8-dab3-4eb9-b335-438660d405e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:41.757060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1072/2143] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:08:41.765621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141c3d-d2d8-4700-ad0c-422ed2288456 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:41.765911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141c3d-d2d8-4700-ad0c-422ed2288456 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:41.766189 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141c3d-d2d8-4700-ad0c-422ed2288456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:41.785052 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-41141c3d-d2d8-4700-ad0c-422ed2288456 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:41.786356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-41141c3d-d2d8-4700-ad0c-422ed2288456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:41.794603 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1072/2144] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:41.798877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff368b8-dab3-4eb9-b335-438660d405e0 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:41.809028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff368b8-dab3-4eb9-b335-438660d405e0 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:41.813502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1600c-810a-449f-b5ff-d35fc96e2540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:41.814148 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1600c-810a-449f-b5ff-d35fc96e2540 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:41.814427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1600c-810a-449f-b5ff-d35fc96e2540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:41.814701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1600c-810a-449f-b5ff-d35fc96e2540 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:41.815422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1600c-810a-449f-b5ff-d35fc96e2540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:08:41.815740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1600c-810a-449f-b5ff-d35fc96e2540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:41.817369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1600c-810a-449f-b5ff-d35fc96e2540 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:41.829687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1073/2145] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:08:41.834116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41141c3d-d2d8-4700-ad0c-422ed2288456 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:41.844300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41141c3d-d2d8-4700-ad0c-422ed2288456 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:41.849423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a28ed-3601-4cd1-a9b5-5fdbc5bbe67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:41.850091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a28ed-3601-4cd1-a9b5-5fdbc5bbe67c admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:41.850392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a28ed-3601-4cd1-a9b5-5fdbc5bbe67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:41.850666 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a28ed-3601-4cd1-a9b5-5fdbc5bbe67c admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:41.851375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a28ed-3601-4cd1-a9b5-5fdbc5bbe67c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:41.853392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a28ed-3601-4cd1-a9b5-5fdbc5bbe67c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:41.879054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1073/2146] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:08:41 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:08:41.883097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1600c-810a-449f-b5ff-d35fc96e2540 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:41.894482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1600c-810a-449f-b5ff-d35fc96e2540 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:41.954581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1880a-a47c-467c-ba6b-1ea151808887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:41.955289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1880a-a47c-467c-ba6b-1ea151808887 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:41.955575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1880a-a47c-467c-ba6b-1ea151808887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:41.955852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1880a-a47c-467c-ba6b-1ea151808887 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:41.956596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1880a-a47c-467c-ba6b-1ea151808887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:41.958526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1880a-a47c-467c-ba6b-1ea151808887 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:41.978585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1074/2147] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:08:41 2022] POST /identity/v3/users => generated 278 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:08:41.982442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a28ed-3601-4cd1-a9b5-5fdbc5bbe67c admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:41.992505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a28ed-3601-4cd1-a9b5-5fdbc5bbe67c admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:41.998120 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd17818-3f92-49eb-8fa8-5a03e4f7064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:41.998775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd17818-3f92-49eb-8fa8-5a03e4f7064e admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:41.999056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd17818-3f92-49eb-8fa8-5a03e4f7064e admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:41.999330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd17818-3f92-49eb-8fa8-5a03e4f7064e admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.000154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd17818-3f92-49eb-8fa8-5a03e4f7064e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:42.001897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd17818-3f92-49eb-8fa8-5a03e4f7064e admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:42.013448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1074/2148] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:08:42.017465 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1880a-a47c-467c-ba6b-1ea151808887 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:42.028153 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1880a-a47c-467c-ba6b-1ea151808887 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:42.032821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5565df-edf6-4e2f-acf6-60f913898621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:42.033477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5565df-edf6-4e2f-acf6-60f913898621 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.033761 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5565df-edf6-4e2f-acf6-60f913898621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.034032 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5565df-edf6-4e2f-acf6-60f913898621 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.034748 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5565df-edf6-4e2f-acf6-60f913898621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:42.036370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5565df-edf6-4e2f-acf6-60f913898621 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:42.047799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1075/2149] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:08:42.052147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd17818-3f92-49eb-8fa8-5a03e4f7064e admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:42.064289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd17818-3f92-49eb-8fa8-5a03e4f7064e admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:42.068803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e10d4-3174-4c13-b4de-da9842cf0675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:42.069673 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e10d4-3174-4c13-b4de-da9842cf0675 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.069952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e10d4-3174-4c13-b4de-da9842cf0675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.070475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e10d4-3174-4c13-b4de-da9842cf0675 admin admin] PATH_INFO: `/v3/projects/de04a96db5154aa5a1151054864b7400/users/1fa9b55adb7241f7ab49ee55b93f2cf6/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.084614 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e10d4-3174-4c13-b4de-da9842cf0675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de04a96db5154aa5a1151054864b7400, user_id=1fa9b55adb7241f7ab49ee55b93f2cf6, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:42.087241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e10d4-3174-4c13-b4de-da9842cf0675 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:42.100039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1075/2150] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:08:42 2022] PUT /identity/v3/projects/de04a96db5154aa5a1151054864b7400/users/1fa9b55adb7241f7ab49ee55b93f2cf6/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:08:42.111326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fba81-97b9-47f3-beb7-a8b5e3124989 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.111699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fba81-97b9-47f3-beb7-a8b5e3124989 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.112050 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fba81-97b9-47f3-beb7-a8b5e3124989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.139127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-323fba81-97b9-47f3-beb7-a8b5e3124989 None None] MFA Rules not processed for user `1fa9b55adb7241f7ab49ee55b93f2cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:42.140366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-323fba81-97b9-47f3-beb7-a8b5e3124989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:42.202715 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1076/2151] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:42.207140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e10d4-3174-4c13-b4de-da9842cf0675 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:42.266053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e10d4-3174-4c13-b4de-da9842cf0675 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:42.270641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756b6ea-ef08-46b6-8ce0-a9c5e620f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:42.271287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756b6ea-ef08-46b6-8ce0-a9c5e620f67b admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.271565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756b6ea-ef08-46b6-8ce0-a9c5e620f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.271836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756b6ea-ef08-46b6-8ce0-a9c5e620f67b admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.272540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756b6ea-ef08-46b6-8ce0-a9c5e620f67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:42.274420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756b6ea-ef08-46b6-8ce0-a9c5e620f67b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:42.303787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1076/2152] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:08:42 2022] POST /identity/v3/projects => generated 355 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:08:42.304995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fba81-97b9-47f3-beb7-a8b5e3124989 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:42.316624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fba81-97b9-47f3-beb7-a8b5e3124989 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:42.385020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2918e71-db02-4b6f-884a-98d618f5d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:42.385894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2918e71-db02-4b6f-884a-98d618f5d772 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.386181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2918e71-db02-4b6f-884a-98d618f5d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.386463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2918e71-db02-4b6f-884a-98d618f5d772 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.387161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2918e71-db02-4b6f-884a-98d618f5d772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:42.389169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2918e71-db02-4b6f-884a-98d618f5d772 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:42.411203 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1077/2153] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:08:42 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:08:42.414946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756b6ea-ef08-46b6-8ce0-a9c5e620f67b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:42.426888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756b6ea-ef08-46b6-8ce0-a9c5e620f67b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:42.432073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc75bb3-da44-48a6-8e4c-a427c47a5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:42.432927 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc75bb3-da44-48a6-8e4c-a427c47a5e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.433275 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc75bb3-da44-48a6-8e4c-a427c47a5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.433619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc75bb3-da44-48a6-8e4c-a427c47a5e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.434355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc75bb3-da44-48a6-8e4c-a427c47a5e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:42.435964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc75bb3-da44-48a6-8e4c-a427c47a5e17 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:42.450007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1077/2154] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:08:42.451069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2918e71-db02-4b6f-884a-98d618f5d772 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:42.460847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2918e71-db02-4b6f-884a-98d618f5d772 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:42.467070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b01b46-483e-479e-b275-a06b55e06b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:42.467440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b01b46-483e-479e-b275-a06b55e06b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.467722 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b01b46-483e-479e-b275-a06b55e06b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.467998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b01b46-483e-479e-b275-a06b55e06b93 admin admin] PATH_INFO: `/v3/projects/5c192124308a4b33b728174eca74f8fb/users/83573c0c95a045788fd005ed1efae685/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.483525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b01b46-483e-479e-b275-a06b55e06b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c192124308a4b33b728174eca74f8fb, user_id=83573c0c95a045788fd005ed1efae685, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:42.486212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b01b46-483e-479e-b275-a06b55e06b93 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:42.499298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1078/2155] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:08:42 2022] PUT /identity/v3/projects/5c192124308a4b33b728174eca74f8fb/users/83573c0c95a045788fd005ed1efae685/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:08:42.503240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc75bb3-da44-48a6-8e4c-a427c47a5e17 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:42.513671 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc75bb3-da44-48a6-8e4c-a427c47a5e17 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:42.578019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dabd7a-c1b2-4cd4-941e-b6e2398a652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:42.578687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dabd7a-c1b2-4cd4-941e-b6e2398a652f admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.578973 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dabd7a-c1b2-4cd4-941e-b6e2398a652f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.579243 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dabd7a-c1b2-4cd4-941e-b6e2398a652f admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.579982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dabd7a-c1b2-4cd4-941e-b6e2398a652f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:42.581582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dabd7a-c1b2-4cd4-941e-b6e2398a652f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:42.593057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1078/2156] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:08:42.597242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b01b46-483e-479e-b275-a06b55e06b93 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:42.608319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b01b46-483e-479e-b275-a06b55e06b93 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:42.613037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c9f9a-0387-4dff-95c6-fa82ce0d284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:42.614080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9f9a-0387-4dff-95c6-fa82ce0d284c admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.614619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9f9a-0387-4dff-95c6-fa82ce0d284c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.615172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9f9a-0387-4dff-95c6-fa82ce0d284c admin admin] PATH_INFO: `/v3/projects/5c192124308a4b33b728174eca74f8fb/users/83573c0c95a045788fd005ed1efae685/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.617581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c9f9a-0387-4dff-95c6-fa82ce0d284c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c192124308a4b33b728174eca74f8fb, user_id=83573c0c95a045788fd005ed1efae685, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:42.620669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c9f9a-0387-4dff-95c6-fa82ce0d284c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:42.631285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1079/2157] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:08:42 2022] PUT /identity/v3/projects/5c192124308a4b33b728174eca74f8fb/users/83573c0c95a045788fd005ed1efae685/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:08:42.641792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a4eb2-6706-4f7e-8603-9aea685cb927 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.642054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a4eb2-6706-4f7e-8603-9aea685cb927 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.642328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a4eb2-6706-4f7e-8603-9aea685cb927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.669669 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-650a4eb2-6706-4f7e-8603-9aea685cb927 None None] MFA Rules not processed for user `83573c0c95a045788fd005ed1efae685`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:42.670824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-650a4eb2-6706-4f7e-8603-9aea685cb927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:42.750435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1079/2158] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:08:42.761847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c9f9a-0387-4dff-95c6-fa82ce0d284c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:42.763540 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-677c9f9a-0387-4dff-95c6-fa82ce0d284c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:42.823350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c9f9a-0387-4dff-95c6-fa82ce0d284c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:42.826939 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4d3f3-00c6-4b6d-92f6-e6c108555dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:42.827579 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4d3f3-00c6-4b6d-92f6-e6c108555dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.827865 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4d3f3-00c6-4b6d-92f6-e6c108555dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.828143 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4d3f3-00c6-4b6d-92f6-e6c108555dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.837172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4d3f3-00c6-4b6d-92f6-e6c108555dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:42.839206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4d3f3-00c6-4b6d-92f6-e6c108555dc5 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:42.849059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1080/2159] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:42 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:08:42.918613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a4eb2-6706-4f7e-8603-9aea685cb927 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:42.927874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a4eb2-6706-4f7e-8603-9aea685cb927 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:42.931453 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225a77f-4419-4a33-874d-8d2e134f859d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:42.932282 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225a77f-4419-4a33-874d-8d2e134f859d service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:42.932563 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225a77f-4419-4a33-874d-8d2e134f859d service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:42.932836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225a77f-4419-4a33-874d-8d2e134f859d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:42.987654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225a77f-4419-4a33-874d-8d2e134f859d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:42.989207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225a77f-4419-4a33-874d-8d2e134f859d service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:42.998596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1080/2160] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:42 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:08:44.865301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4d3f3-00c6-4b6d-92f6-e6c108555dc5 service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:44.866709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3db4d3f3-00c6-4b6d-92f6-e6c108555dc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:44.930194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4d3f3-00c6-4b6d-92f6-e6c108555dc5 service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:44.935169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:44.936060 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:44.936381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:44.936665 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] PATH_INFO: `/v3/users/02b79df3f8cd495b8e1c6f68cd17ace3` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:44.937862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b79df3f8cd495b8e1c6f68cd17ace3)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:44.939783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:44.985520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b79df3f8cd495b8e1c6f68cd17ace3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:44.986170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b79df3f8cd495b8e1c6f68cd17ace3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:44.992784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b79df3f8cd495b8e1c6f68cd17ace3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:45.001638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b79df3f8cd495b8e1c6f68cd17ace3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:45.002262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b79df3f8cd495b8e1c6f68cd17ace3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:45.020517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1081/2161] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:08:44 2022] DELETE /identity/v3/users/02b79df3f8cd495b8e1c6f68cd17ace3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:45.025219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1e32-5456-4849-b243-17b0a436025a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:45.025706 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1e32-5456-4849-b243-17b0a436025a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:45.025801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1e32-5456-4849-b243-17b0a436025a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:45.043886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-314b1e32-5456-4849-b243-17b0a436025a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:45.045114 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-314b1e32-5456-4849-b243-17b0a436025a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:45.108559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1081/2162] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:08:45.117913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:45.119457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:45.178321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf788de-98d3-4279-a371-88888dbe3f39 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:45.183125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53567a9-dcff-4de2-a4a8-8b3e6c8c13b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:45.183802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53567a9-dcff-4de2-a4a8-8b3e6c8c13b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:45.184078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53567a9-dcff-4de2-a4a8-8b3e6c8c13b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:45.184384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53567a9-dcff-4de2-a4a8-8b3e6c8c13b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:45.194006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53567a9-dcff-4de2-a4a8-8b3e6c8c13b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:45.195707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53567a9-dcff-4de2-a4a8-8b3e6c8c13b2 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:45.205951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1082/2163] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:08:45.474076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b1e32-5456-4849-b243-17b0a436025a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:08:45.475827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-314b1e32-5456-4849-b243-17b0a436025a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:45.489288 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b1e32-5456-4849-b243-17b0a436025a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:08:45.495003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:08:45.497269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:45.497557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:45.497835 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] PATH_INFO: `/v3/projects/d2b6122241c04fd59e645625065de32b` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:45.499663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b6122241c04fd59e645625065de32b)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:08:45.502038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:08:45.564147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b6122241c04fd59e645625065de32b', 'request_id': 'req-3d973e21-78dc-4e49-876b-86bf5e8947ef'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:45.578605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b6122241c04fd59e645625065de32b', 'request_id': 'req-3d973e21-78dc-4e49-876b-86bf5e8947ef'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:45.589910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b6122241c04fd59e645625065de32b', 'request_id': 'req-3d973e21-78dc-4e49-876b-86bf5e8947ef'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:45.602004 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] The token cache is being invalidate because project d2b6122241c04fd59e645625065de32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:08:45.602292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:45.602949 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:08:45.608261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1082/2164] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:08:45 2022] DELETE /identity/v3/projects/d2b6122241c04fd59e645625065de32b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:08:53.276756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce479-8efb-4303-ad0b-6790d228a1f5 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:08:53.277274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce479-8efb-4303-ad0b-6790d228a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:08:53.277274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ce479-8efb-4303-ad0b-6790d228a1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:08:53.296331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-591ce479-8efb-4303-ad0b-6790d228a1f5 None None] MFA Rules not processed for user `bb9da9200f804a4a987f2cdb49f6801d`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:08:53.297614 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-591ce479-8efb-4303-ad0b-6790d228a1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:08:53.368628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1083/2165] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:08:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:00.178769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:00.180203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:00.250177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d973e21-78dc-4e49-876b-86bf5e8947ef admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:00.254853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:00.255712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:00.255990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:00.256297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] PATH_INFO: `/v3/users/1fa9b55adb7241f7ab49ee55b93f2cf6` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:00.257597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa9b55adb7241f7ab49ee55b93f2cf6)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:00.259543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:00.304936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa9b55adb7241f7ab49ee55b93f2cf6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.312114 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa9b55adb7241f7ab49ee55b93f2cf6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.319123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa9b55adb7241f7ab49ee55b93f2cf6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.319740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa9b55adb7241f7ab49ee55b93f2cf6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.320639 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa9b55adb7241f7ab49ee55b93f2cf6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.337196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1083/2166] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:09:00 2022] DELETE /identity/v3/users/1fa9b55adb7241f7ab49ee55b93f2cf6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:00.342243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999a5ae-4b28-4118-909e-b74c916c4fc2 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:00.342733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999a5ae-4b28-4118-909e-b74c916c4fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:00.342851 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999a5ae-4b28-4118-909e-b74c916c4fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:00.360638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a999a5ae-4b28-4118-909e-b74c916c4fc2 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:00.361815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a999a5ae-4b28-4118-909e-b74c916c4fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:00.416601 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1084/2167] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:00.426631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:00.428026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:00.483234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e9513-9c1b-427f-a264-78eb90015028 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:00.487112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2fd02-7270-4cf0-b54f-448d15f1d080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:00.487767 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2fd02-7270-4cf0-b54f-448d15f1d080 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:00.488050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2fd02-7270-4cf0-b54f-448d15f1d080 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:00.488373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2fd02-7270-4cf0-b54f-448d15f1d080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:00.497959 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2fd02-7270-4cf0-b54f-448d15f1d080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:00.499387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2fd02-7270-4cf0-b54f-448d15f1d080 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:00.508682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1084/2168] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:00.766248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999a5ae-4b28-4118-909e-b74c916c4fc2 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:00.767723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a999a5ae-4b28-4118-909e-b74c916c4fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:00.779808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999a5ae-4b28-4118-909e-b74c916c4fc2 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:00.784489 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:00.785351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:00.785634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:00.785910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] PATH_INFO: `/v3/projects/de04a96db5154aa5a1151054864b7400` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:00.787131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de04a96db5154aa5a1151054864b7400)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:00.789093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:00.836015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de04a96db5154aa5a1151054864b7400', 'request_id': 'req-bd6ead90-f902-48cf-ae16-4d3145bdaec0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.842230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de04a96db5154aa5a1151054864b7400', 'request_id': 'req-bd6ead90-f902-48cf-ae16-4d3145bdaec0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.847823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de04a96db5154aa5a1151054864b7400', 'request_id': 'req-bd6ead90-f902-48cf-ae16-4d3145bdaec0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.859899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] The token cache is being invalidate because project de04a96db5154aa5a1151054864b7400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:09:00.860196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.860846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.862366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1085/2169] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:09:00 2022] DELETE /identity/v3/projects/de04a96db5154aa5a1151054864b7400 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:00.866273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2fd02-7270-4cf0-b54f-448d15f1d080 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:00.876165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2fd02-7270-4cf0-b54f-448d15f1d080 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:00.928887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67971364-70ec-4d07-b7e1-4f1b53a30342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:00.929734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67971364-70ec-4d07-b7e1-4f1b53a30342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:00.930013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67971364-70ec-4d07-b7e1-4f1b53a30342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:00.930285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67971364-70ec-4d07-b7e1-4f1b53a30342 admin admin] PATH_INFO: `/v3/users/83573c0c95a045788fd005ed1efae685` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:00.931471 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67971364-70ec-4d07-b7e1-4f1b53a30342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83573c0c95a045788fd005ed1efae685)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:00.933389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67971364-70ec-4d07-b7e1-4f1b53a30342 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:00.977195 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-67971364-70ec-4d07-b7e1-4f1b53a30342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83573c0c95a045788fd005ed1efae685'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.984476 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-67971364-70ec-4d07-b7e1-4f1b53a30342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83573c0c95a045788fd005ed1efae685'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.994147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-67971364-70ec-4d07-b7e1-4f1b53a30342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83573c0c95a045788fd005ed1efae685'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.994757 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-67971364-70ec-4d07-b7e1-4f1b53a30342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83573c0c95a045788fd005ed1efae685'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:00.995345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-67971364-70ec-4d07-b7e1-4f1b53a30342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83573c0c95a045788fd005ed1efae685'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:01.013121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1085/2170] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:09:00 2022] DELETE /identity/v3/users/83573c0c95a045788fd005ed1efae685 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:01.289861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:01.291309 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:01.307048 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ead90-f902-48cf-ae16-4d3145bdaec0 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:01.365909 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:01.366684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:01.366992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:01.367271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] PATH_INFO: `/v3/projects/5c192124308a4b33b728174eca74f8fb` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:01.368486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c192124308a4b33b728174eca74f8fb)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:01.370392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:01.419000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c192124308a4b33b728174eca74f8fb', 'request_id': 'req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:01.425137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c192124308a4b33b728174eca74f8fb', 'request_id': 'req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:01.430347 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c192124308a4b33b728174eca74f8fb', 'request_id': 'req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:01.442582 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] The token cache is being invalidate because project 5c192124308a4b33b728174eca74f8fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:09:01.442866 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:01.443498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8d7b93c5-9b17-4d3f-88f5-2fbe35bd32e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:01.445160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1086/2171] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:09:01 2022] DELETE /identity/v3/projects/5c192124308a4b33b728174eca74f8fb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:01.451925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f94a2-b3b0-4110-b92a-c03aa8193b3b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:01.452429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f94a2-b3b0-4110-b92a-c03aa8193b3b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:01.452520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f94a2-b3b0-4110-b92a-c03aa8193b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:01.469600 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-666f94a2-b3b0-4110-b92a-c03aa8193b3b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:01.470780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-666f94a2-b3b0-4110-b92a-c03aa8193b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:01.529291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1086/2172] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:01.537765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef870c-35d4-4c00-abb9-93e7285c7cc1 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:01.538075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef870c-35d4-4c00-abb9-93e7285c7cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:01.538355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef870c-35d4-4c00-abb9-93e7285c7cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:01.557251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-d4ef870c-35d4-4c00-abb9-93e7285c7cc1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:01.558429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-d4ef870c-35d4-4c00-abb9-93e7285c7cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:01.566742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1087/2173] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:01.571249 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f94a2-b3b0-4110-b92a-c03aa8193b3b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:01.580873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f94a2-b3b0-4110-b92a-c03aa8193b3b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:01.585487 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805f2f-2034-433b-aefb-20cf7e69fa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:01.586136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805f2f-2034-433b-aefb-20cf7e69fa6e admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:01.586421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805f2f-2034-433b-aefb-20cf7e69fa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:01.586699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805f2f-2034-433b-aefb-20cf7e69fa6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:01.587425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09805f2f-2034-433b-aefb-20cf7e69fa6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:09:01.587737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09805f2f-2034-433b-aefb-20cf7e69fa6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:01.589363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09805f2f-2034-433b-aefb-20cf7e69fa6e admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:01.600777 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1087/2174] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:09:01.604970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef870c-35d4-4c00-abb9-93e7285c7cc1 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:01.614433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef870c-35d4-4c00-abb9-93e7285c7cc1 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:01.619003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc749553-28f6-423e-8cb7-0bdf539aa3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:01.619579 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc749553-28f6-423e-8cb7-0bdf539aa3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:01.619858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc749553-28f6-423e-8cb7-0bdf539aa3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:01.620130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc749553-28f6-423e-8cb7-0bdf539aa3c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:01.620844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc749553-28f6-423e-8cb7-0bdf539aa3c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:01.623295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc749553-28f6-423e-8cb7-0bdf539aa3c7 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:01.647776 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1088/2175] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:09:01 2022] POST /identity/v3/projects => generated 391 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:09:01.651967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805f2f-2034-433b-aefb-20cf7e69fa6e admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:01.662038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805f2f-2034-433b-aefb-20cf7e69fa6e admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:01.716662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae3303-ad9c-459d-9299-b9b1d74d4b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:01.717373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae3303-ad9c-459d-9299-b9b1d74d4b93 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:01.717659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae3303-ad9c-459d-9299-b9b1d74d4b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:01.717936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae3303-ad9c-459d-9299-b9b1d74d4b93 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:01.718626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae3303-ad9c-459d-9299-b9b1d74d4b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:01.720557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae3303-ad9c-459d-9299-b9b1d74d4b93 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:01.740427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1088/2176] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:09:01 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:09:01.744350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc749553-28f6-423e-8cb7-0bdf539aa3c7 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:01.755001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc749553-28f6-423e-8cb7-0bdf539aa3c7 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:01.759575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df619d8-4253-4830-984a-e4875f17b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:01.760253 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df619d8-4253-4830-984a-e4875f17b8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:01.760540 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df619d8-4253-4830-984a-e4875f17b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:01.760815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df619d8-4253-4830-984a-e4875f17b8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:01.761540 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df619d8-4253-4830-984a-e4875f17b8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:01.763389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df619d8-4253-4830-984a-e4875f17b8e2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:01.773400 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1089/2177] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:09:01.777050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae3303-ad9c-459d-9299-b9b1d74d4b93 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:01.786715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae3303-ad9c-459d-9299-b9b1d74d4b93 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:01.791285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05832902-a1b2-453c-8436-cd50075a326b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:01.792479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05832902-a1b2-453c-8436-cd50075a326b admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:01.792757 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05832902-a1b2-453c-8436-cd50075a326b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:01.793696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05832902-a1b2-453c-8436-cd50075a326b admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:01.794491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05832902-a1b2-453c-8436-cd50075a326b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:01.796065 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05832902-a1b2-453c-8436-cd50075a326b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:01.805649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1089/2178] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:09:01.810161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df619d8-4253-4830-984a-e4875f17b8e2 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:01.819790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df619d8-4253-4830-984a-e4875f17b8e2 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:01.824671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1297aa2-44f6-41c4-8d7a-c826bec05242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:01.825493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1297aa2-44f6-41c4-8d7a-c826bec05242 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:01.825772 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1297aa2-44f6-41c4-8d7a-c826bec05242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:01.826047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1297aa2-44f6-41c4-8d7a-c826bec05242 admin admin] PATH_INFO: `/v3/projects/0fbdfd96856c497aa5c183a7da54fb21/users/cba2962a8a7440bba5abc105b47491dc/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:01.841468 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1297aa2-44f6-41c4-8d7a-c826bec05242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fbdfd96856c497aa5c183a7da54fb21, user_id=cba2962a8a7440bba5abc105b47491dc, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:01.844090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1297aa2-44f6-41c4-8d7a-c826bec05242 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:01.857114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1090/2179] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:09:01 2022] PUT /identity/v3/projects/0fbdfd96856c497aa5c183a7da54fb21/users/cba2962a8a7440bba5abc105b47491dc/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:09:01.867183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4185c7-6185-4cc3-84de-cc2c9bf60337 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:01.867506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4185c7-6185-4cc3-84de-cc2c9bf60337 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:01.867788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4185c7-6185-4cc3-84de-cc2c9bf60337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:01.893682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ee4185c7-6185-4cc3-84de-cc2c9bf60337 None None] MFA Rules not processed for user `cba2962a8a7440bba5abc105b47491dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:01.894838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ee4185c7-6185-4cc3-84de-cc2c9bf60337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:01.956331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1090/2180] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:01.960930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1297aa2-44f6-41c4-8d7a-c826bec05242 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:02.021689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1297aa2-44f6-41c4-8d7a-c826bec05242 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:02.026347 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e05c08-ac66-4726-955b-7ec2e1bae9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:02.026998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e05c08-ac66-4726-955b-7ec2e1bae9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:02.027436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e05c08-ac66-4726-955b-7ec2e1bae9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:02.027623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e05c08-ac66-4726-955b-7ec2e1bae9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:02.028276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e05c08-ac66-4726-955b-7ec2e1bae9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:02.030213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e05c08-ac66-4726-955b-7ec2e1bae9b6 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:02.054035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1091/2181] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:09:01 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:09:02.058166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4185c7-6185-4cc3-84de-cc2c9bf60337 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:02.071861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4185c7-6185-4cc3-84de-cc2c9bf60337 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:02.126627 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf17554-56d2-470d-ac64-5cc23e4d86a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:02.127291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf17554-56d2-470d-ac64-5cc23e4d86a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:02.127577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf17554-56d2-470d-ac64-5cc23e4d86a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:02.127853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf17554-56d2-470d-ac64-5cc23e4d86a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:02.128567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf17554-56d2-470d-ac64-5cc23e4d86a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:02.130491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf17554-56d2-470d-ac64-5cc23e4d86a1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:02.151043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1091/2182] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:09:02 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:09:02.155066 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e05c08-ac66-4726-955b-7ec2e1bae9b6 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:02.165379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e05c08-ac66-4726-955b-7ec2e1bae9b6 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:02.169900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8f5c5-0b17-4006-bd9c-0dece74795a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:02.170551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8f5c5-0b17-4006-bd9c-0dece74795a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:02.170830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8f5c5-0b17-4006-bd9c-0dece74795a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:02.171102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8f5c5-0b17-4006-bd9c-0dece74795a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:02.171819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8f5c5-0b17-4006-bd9c-0dece74795a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:02.173678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8f5c5-0b17-4006-bd9c-0dece74795a3 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:02.184550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1092/2183] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:09:02.188662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf17554-56d2-470d-ac64-5cc23e4d86a1 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:02.198833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf17554-56d2-470d-ac64-5cc23e4d86a1 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:02.204069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a370-e9ea-48cd-af2d-55c86e201ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:02.204996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a370-e9ea-48cd-af2d-55c86e201ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:02.205274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a370-e9ea-48cd-af2d-55c86e201ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:02.205553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a370-e9ea-48cd-af2d-55c86e201ae2 admin admin] PATH_INFO: `/v3/projects/2090e7bb91d243dd9b71030fb8719564/users/e2492179eeca4a7ead28031ce82c6322/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:02.221188 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642a370-e9ea-48cd-af2d-55c86e201ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2090e7bb91d243dd9b71030fb8719564, user_id=e2492179eeca4a7ead28031ce82c6322, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:02.223897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642a370-e9ea-48cd-af2d-55c86e201ae2 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:02.237537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1092/2184] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:09:02 2022] PUT /identity/v3/projects/2090e7bb91d243dd9b71030fb8719564/users/e2492179eeca4a7ead28031ce82c6322/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:02.241506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8f5c5-0b17-4006-bd9c-0dece74795a3 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:02.252308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8f5c5-0b17-4006-bd9c-0dece74795a3 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:02.312631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18c930-eb4e-4291-8aca-35809426346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:02.313394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18c930-eb4e-4291-8aca-35809426346a admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:02.313837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18c930-eb4e-4291-8aca-35809426346a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:02.314129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18c930-eb4e-4291-8aca-35809426346a admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:02.314966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18c930-eb4e-4291-8aca-35809426346a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:02.316641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18c930-eb4e-4291-8aca-35809426346a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:02.331745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1093/2185] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:09:02.335688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a370-e9ea-48cd-af2d-55c86e201ae2 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:02.345822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a370-e9ea-48cd-af2d-55c86e201ae2 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:02.350390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fe5e2-4a42-45c5-ae64-c5625cf07a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:02.351259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe5e2-4a42-45c5-ae64-c5625cf07a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:02.351536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe5e2-4a42-45c5-ae64-c5625cf07a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:02.351807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe5e2-4a42-45c5-ae64-c5625cf07a45 admin admin] PATH_INFO: `/v3/projects/2090e7bb91d243dd9b71030fb8719564/users/e2492179eeca4a7ead28031ce82c6322/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:02.353803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fe5e2-4a42-45c5-ae64-c5625cf07a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2090e7bb91d243dd9b71030fb8719564, user_id=e2492179eeca4a7ead28031ce82c6322, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:02.356969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fe5e2-4a42-45c5-ae64-c5625cf07a45 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:02.367017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1093/2186] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:09:02 2022] PUT /identity/v3/projects/2090e7bb91d243dd9b71030fb8719564/users/e2492179eeca4a7ead28031ce82c6322/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:02.377760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603927f-3e2c-4d8e-b890-d6b62f236fd0 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:02.378227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603927f-3e2c-4d8e-b890-d6b62f236fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:02.378318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603927f-3e2c-4d8e-b890-d6b62f236fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:02.403973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1603927f-3e2c-4d8e-b890-d6b62f236fd0 None None] MFA Rules not processed for user `e2492179eeca4a7ead28031ce82c6322`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:02.405160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1603927f-3e2c-4d8e-b890-d6b62f236fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:02.473447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1094/2187] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:02.484576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fe5e2-4a42-45c5-ae64-c5625cf07a45 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:02.486330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-320fe5e2-4a42-45c5-ae64-c5625cf07a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:02.571852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fe5e2-4a42-45c5-ae64-c5625cf07a45 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:02.575584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57703944-4a0f-4baa-b6cc-a1cfa756de77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:02.576258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57703944-4a0f-4baa-b6cc-a1cfa756de77 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:02.576546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57703944-4a0f-4baa-b6cc-a1cfa756de77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:02.576823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57703944-4a0f-4baa-b6cc-a1cfa756de77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:02.585788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57703944-4a0f-4baa-b6cc-a1cfa756de77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:02.587198 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57703944-4a0f-4baa-b6cc-a1cfa756de77 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:02.596969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1094/2188] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:02.640648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603927f-3e2c-4d8e-b890-d6b62f236fd0 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:02.642017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1603927f-3e2c-4d8e-b890-d6b62f236fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:02.654371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603927f-3e2c-4d8e-b890-d6b62f236fd0 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:02.657960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca6c8c-958d-4db3-b644-da70d506cdad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:02.658620 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6c8c-958d-4db3-b644-da70d506cdad service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:02.658905 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6c8c-958d-4db3-b644-da70d506cdad service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:02.659180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6c8c-958d-4db3-b644-da70d506cdad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:02.713740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca6c8c-958d-4db3-b644-da70d506cdad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:02.715952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca6c8c-958d-4db3-b644-da70d506cdad service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:02.724623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1095/2189] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:06.999426 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57703944-4a0f-4baa-b6cc-a1cfa756de77 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:07.064539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57703944-4a0f-4baa-b6cc-a1cfa756de77 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:07.069163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:07.070028 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:07.070560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:07.070835 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] PATH_INFO: `/v3/users/cba2962a8a7440bba5abc105b47491dc` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:07.072029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba2962a8a7440bba5abc105b47491dc)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:07.073989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:07.125702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba2962a8a7440bba5abc105b47491dc'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.132488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba2962a8a7440bba5abc105b47491dc'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.141415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba2962a8a7440bba5abc105b47491dc'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.142229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba2962a8a7440bba5abc105b47491dc'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.142843 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba2962a8a7440bba5abc105b47491dc'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.159998 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1095/2190] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:09:06 2022] DELETE /identity/v3/users/cba2962a8a7440bba5abc105b47491dc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:07.164668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27acbdc-10b9-4d68-a473-1b66c016f126 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:07.165490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27acbdc-10b9-4d68-a473-1b66c016f126 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:07.165956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27acbdc-10b9-4d68-a473-1b66c016f126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:07.183083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-b27acbdc-10b9-4d68-a473-1b66c016f126 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:07.184897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b27acbdc-10b9-4d68-a473-1b66c016f126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:07.243251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1096/2191] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:07.253184 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:07.254558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:07.309842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1aeed-307e-4cbe-a166-e77a89575320 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:07.313415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be7cd3-fd13-4162-8ffd-c1304ee1d768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:07.314053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7cd3-fd13-4162-8ffd-c1304ee1d768 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:07.314329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7cd3-fd13-4162-8ffd-c1304ee1d768 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:07.314602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7cd3-fd13-4162-8ffd-c1304ee1d768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:07.323715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be7cd3-fd13-4162-8ffd-c1304ee1d768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:07.325336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be7cd3-fd13-4162-8ffd-c1304ee1d768 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:07.334814 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1096/2192] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:07.602903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27acbdc-10b9-4d68-a473-1b66c016f126 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:07.604343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b27acbdc-10b9-4d68-a473-1b66c016f126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:07.616127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27acbdc-10b9-4d68-a473-1b66c016f126 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:07.620712 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:07.621829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:07.622118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:07.622392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] PATH_INFO: `/v3/projects/0fbdfd96856c497aa5c183a7da54fb21` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:07.623573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fbdfd96856c497aa5c183a7da54fb21)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:07.625515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:07.671736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fbdfd96856c497aa5c183a7da54fb21', 'request_id': 'req-675311c3-00b5-4daf-9627-581a3573fd07'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.677816 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fbdfd96856c497aa5c183a7da54fb21', 'request_id': 'req-675311c3-00b5-4daf-9627-581a3573fd07'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.683195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fbdfd96856c497aa5c183a7da54fb21', 'request_id': 'req-675311c3-00b5-4daf-9627-581a3573fd07'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.694956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] The token cache is being invalidate because project 0fbdfd96856c497aa5c183a7da54fb21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:09:07.695242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.696107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.697656 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1097/2193] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:09:07 2022] DELETE /identity/v3/projects/0fbdfd96856c497aa5c183a7da54fb21 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:07.702151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be7cd3-fd13-4162-8ffd-c1304ee1d768 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:07.711465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be7cd3-fd13-4162-8ffd-c1304ee1d768 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:07.767140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532420f4-3971-4048-81c2-9a980f3f8c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:07.768008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532420f4-3971-4048-81c2-9a980f3f8c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:07.768356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532420f4-3971-4048-81c2-9a980f3f8c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:07.768602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532420f4-3971-4048-81c2-9a980f3f8c4d admin admin] PATH_INFO: `/v3/users/e2492179eeca4a7ead28031ce82c6322` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:07.769801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532420f4-3971-4048-81c2-9a980f3f8c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2492179eeca4a7ead28031ce82c6322)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:07.771719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532420f4-3971-4048-81c2-9a980f3f8c4d admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:07.817318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-532420f4-3971-4048-81c2-9a980f3f8c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2492179eeca4a7ead28031ce82c6322'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.824885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-532420f4-3971-4048-81c2-9a980f3f8c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2492179eeca4a7ead28031ce82c6322'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.831892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-532420f4-3971-4048-81c2-9a980f3f8c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2492179eeca4a7ead28031ce82c6322'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.832495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-532420f4-3971-4048-81c2-9a980f3f8c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2492179eeca4a7ead28031ce82c6322'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.833086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-532420f4-3971-4048-81c2-9a980f3f8c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2492179eeca4a7ead28031ce82c6322'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:07.850368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1097/2194] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:09:07 2022] DELETE /identity/v3/users/e2492179eeca4a7ead28031ce82c6322 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:08.107343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:08.108852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:08.123571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675311c3-00b5-4daf-9627-581a3573fd07 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:08.181554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:08.182405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:08.182693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:08.182974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] PATH_INFO: `/v3/projects/2090e7bb91d243dd9b71030fb8719564` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:08.184755 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2090e7bb91d243dd9b71030fb8719564)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:08.186655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:08.232998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2090e7bb91d243dd9b71030fb8719564', 'request_id': 'req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:08.238988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2090e7bb91d243dd9b71030fb8719564', 'request_id': 'req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:08.244592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2090e7bb91d243dd9b71030fb8719564', 'request_id': 'req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:08.257860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] The token cache is being invalidate because project 2090e7bb91d243dd9b71030fb8719564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:09:08.258149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:08.258774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9fead546-cb49-4c1a-8fd2-fee94ce02a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:08.260403 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1098/2195] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:09:08 2022] DELETE /identity/v3/projects/2090e7bb91d243dd9b71030fb8719564 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:09:08.266017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379ba9-c201-41dc-b95c-37b0627ea229 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:08.266571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379ba9-c201-41dc-b95c-37b0627ea229 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:08.266672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379ba9-c201-41dc-b95c-37b0627ea229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:08.284773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ff379ba9-c201-41dc-b95c-37b0627ea229 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:08.285984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ff379ba9-c201-41dc-b95c-37b0627ea229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:08.346682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1098/2196] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:09:08.356534 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a120-6fd6-41ee-a9f7-4c876a5243b0 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:08.356869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a120-6fd6-41ee-a9f7-4c876a5243b0 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:08.357082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a120-6fd6-41ee-a9f7-4c876a5243b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:08.376484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c071a120-6fd6-41ee-a9f7-4c876a5243b0 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:08.377684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c071a120-6fd6-41ee-a9f7-4c876a5243b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:08.386122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1099/2197] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:08.390799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff379ba9-c201-41dc-b95c-37b0627ea229 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:08.400308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff379ba9-c201-41dc-b95c-37b0627ea229 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:08.405068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38dca8-f4d4-4156-a695-375b30bb5565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:08.405713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38dca8-f4d4-4156-a695-375b30bb5565 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:08.405993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38dca8-f4d4-4156-a695-375b30bb5565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:08.406264 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38dca8-f4d4-4156-a695-375b30bb5565 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:08.406982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38dca8-f4d4-4156-a695-375b30bb5565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:09:08.407288 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38dca8-f4d4-4156-a695-375b30bb5565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:08.408933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38dca8-f4d4-4156-a695-375b30bb5565 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:08.420887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1099/2198] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:09:08.425417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071a120-6fd6-41ee-a9f7-4c876a5243b0 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:08.435499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071a120-6fd6-41ee-a9f7-4c876a5243b0 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:08.440323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac77676-995a-48ca-808d-6617336c548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:08.440976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac77676-995a-48ca-808d-6617336c548e admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:08.441254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac77676-995a-48ca-808d-6617336c548e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:08.441525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac77676-995a-48ca-808d-6617336c548e admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:08.442206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac77676-995a-48ca-808d-6617336c548e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:08.444102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac77676-995a-48ca-808d-6617336c548e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:08.468414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1100/2199] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:09:08 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:09:08.472362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38dca8-f4d4-4156-a695-375b30bb5565 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:08.483555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38dca8-f4d4-4156-a695-375b30bb5565 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:08.540801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aceb86-10e1-4596-866b-58f7efcc4205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:08.541478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aceb86-10e1-4596-866b-58f7efcc4205 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:08.541763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aceb86-10e1-4596-866b-58f7efcc4205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:08.542040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aceb86-10e1-4596-866b-58f7efcc4205 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:08.543224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aceb86-10e1-4596-866b-58f7efcc4205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:08.545419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aceb86-10e1-4596-866b-58f7efcc4205 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:08.566293 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1100/2200] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:09:08 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:09:08.569920 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac77676-995a-48ca-808d-6617336c548e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:08.580341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac77676-995a-48ca-808d-6617336c548e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:08.585082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fcee5-424f-4058-a595-4cb937cea0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:08.585675 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fcee5-424f-4058-a595-4cb937cea0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:08.585956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fcee5-424f-4058-a595-4cb937cea0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:08.586214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fcee5-424f-4058-a595-4cb937cea0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:08.586941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fcee5-424f-4058-a595-4cb937cea0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:08.588580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fcee5-424f-4058-a595-4cb937cea0f6 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:08.606216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1101/2201] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:09:08.607230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aceb86-10e1-4596-866b-58f7efcc4205 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:08.618597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aceb86-10e1-4596-866b-58f7efcc4205 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:08.628594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f964e-9bf2-425a-95e2-e948663360dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:08.629277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f964e-9bf2-425a-95e2-e948663360dc admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:08.629561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f964e-9bf2-425a-95e2-e948663360dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:08.629839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f964e-9bf2-425a-95e2-e948663360dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:08.630741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f964e-9bf2-425a-95e2-e948663360dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:08.632790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f964e-9bf2-425a-95e2-e948663360dc admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:08.648897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1101/2202] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:09:08.649430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fcee5-424f-4058-a595-4cb937cea0f6 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:08.661137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fcee5-424f-4058-a595-4cb937cea0f6 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:08.665951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83492b29-7cb7-44de-bbc2-e9939792b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:08.666830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83492b29-7cb7-44de-bbc2-e9939792b194 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:08.667107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83492b29-7cb7-44de-bbc2-e9939792b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:08.667377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83492b29-7cb7-44de-bbc2-e9939792b194 admin admin] PATH_INFO: `/v3/projects/bb36f652aaa94043a67a3e9ceb1908ba/users/165dcc0fd8c14d7f894b946d1e6030a1/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:08.683190 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83492b29-7cb7-44de-bbc2-e9939792b194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb36f652aaa94043a67a3e9ceb1908ba, user_id=165dcc0fd8c14d7f894b946d1e6030a1, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:08.685961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83492b29-7cb7-44de-bbc2-e9939792b194 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:08.700121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1102/2203] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:09:08 2022] PUT /identity/v3/projects/bb36f652aaa94043a67a3e9ceb1908ba/users/165dcc0fd8c14d7f894b946d1e6030a1/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:08.710085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4871-c80d-454b-8106-045674b08be4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:08.710382 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4871-c80d-454b-8106-045674b08be4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:08.710667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4871-c80d-454b-8106-045674b08be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:08.738647 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-782c4871-c80d-454b-8106-045674b08be4 None None] MFA Rules not processed for user `165dcc0fd8c14d7f894b946d1e6030a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:08.740410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-782c4871-c80d-454b-8106-045674b08be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:08.816232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1102/2204] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:08.828104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83492b29-7cb7-44de-bbc2-e9939792b194 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:08.830337 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-83492b29-7cb7-44de-bbc2-e9939792b194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:08.897256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83492b29-7cb7-44de-bbc2-e9939792b194 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:08.901077 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b590d-dedb-426b-b7a1-8282617d46bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:08.901807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b590d-dedb-426b-b7a1-8282617d46bf service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:08.902046 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b590d-dedb-426b-b7a1-8282617d46bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:08.902346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b590d-dedb-426b-b7a1-8282617d46bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:08.911109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b590d-dedb-426b-b7a1-8282617d46bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:08.912618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b590d-dedb-426b-b7a1-8282617d46bf service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:08.921850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1103/2205] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:08.946705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c4871-c80d-454b-8106-045674b08be4 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:09.010626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c4871-c80d-454b-8106-045674b08be4 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:09.015715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:09.016616 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:09.016899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:09.017175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] PATH_INFO: `/v3/users/165dcc0fd8c14d7f894b946d1e6030a1` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:09.018367 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=165dcc0fd8c14d7f894b946d1e6030a1)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:09.020303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:09.065815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165dcc0fd8c14d7f894b946d1e6030a1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:09.072605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165dcc0fd8c14d7f894b946d1e6030a1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:09.079398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165dcc0fd8c14d7f894b946d1e6030a1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:09.080014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165dcc0fd8c14d7f894b946d1e6030a1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:09.080652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165dcc0fd8c14d7f894b946d1e6030a1'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:09.097106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1103/2206] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:09:08 2022] DELETE /identity/v3/users/165dcc0fd8c14d7f894b946d1e6030a1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:09.101564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d8579-ee68-4c64-b5a7-c9f068af651e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:09.101853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d8579-ee68-4c64-b5a7-c9f068af651e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:09.102157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d8579-ee68-4c64-b5a7-c9f068af651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:09.119257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-da7d8579-ee68-4c64-b5a7-c9f068af651e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:09.120458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-da7d8579-ee68-4c64-b5a7-c9f068af651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:09.177819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1104/2207] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:09.187857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:09.189301 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:09.247051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99897853-e599-4e76-afad-1f0bd1627a08 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:09.262771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0840a59-4987-4dd9-8f1c-9386b706bbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:09.262771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0840a59-4987-4dd9-8f1c-9386b706bbdf service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:09.262771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0840a59-4987-4dd9-8f1c-9386b706bbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:09.262771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0840a59-4987-4dd9-8f1c-9386b706bbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:09.265559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0840a59-4987-4dd9-8f1c-9386b706bbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:09.266987 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0840a59-4987-4dd9-8f1c-9386b706bbdf service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:09.276333 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1104/2208] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:09.561969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d8579-ee68-4c64-b5a7-c9f068af651e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:09.564654 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-da7d8579-ee68-4c64-b5a7-c9f068af651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:09.581291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d8579-ee68-4c64-b5a7-c9f068af651e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:09.586743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:09.587613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:09.587898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:09.588192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] PATH_INFO: `/v3/projects/bb36f652aaa94043a67a3e9ceb1908ba` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:09.589424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb36f652aaa94043a67a3e9ceb1908ba)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:09.592144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:09.646665 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb36f652aaa94043a67a3e9ceb1908ba', 'request_id': 'req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:09.654272 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb36f652aaa94043a67a3e9ceb1908ba', 'request_id': 'req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:09.660108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb36f652aaa94043a67a3e9ceb1908ba', 'request_id': 'req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:09.675053 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] The token cache is being invalidate because project bb36f652aaa94043a67a3e9ceb1908ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:09:09.675436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:09.676155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af80002c-4a1f-403d-a6b6-1e78fcaf8b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:09.677808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1105/2209] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:09:09 2022] DELETE /identity/v3/projects/bb36f652aaa94043a67a3e9ceb1908ba => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:09.682586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441889-0c5e-4429-8371-3ed82686e373 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:09.682880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441889-0c5e-4429-8371-3ed82686e373 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:09.683157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441889-0c5e-4429-8371-3ed82686e373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:09.703498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-cb441889-0c5e-4429-8371-3ed82686e373 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:09.705597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-cb441889-0c5e-4429-8371-3ed82686e373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:09.774227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1105/2210] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:09.776020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5be85a-7aa1-486c-b051-8bd1c33b36f7 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:09.776426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5be85a-7aa1-486c-b051-8bd1c33b36f7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:09.776779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5be85a-7aa1-486c-b051-8bd1c33b36f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:09.796821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-4d5be85a-7aa1-486c-b051-8bd1c33b36f7 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:09.798130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4d5be85a-7aa1-486c-b051-8bd1c33b36f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:09.806314 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1106/2211] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:09:09.810809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb441889-0c5e-4429-8371-3ed82686e373 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:09.820646 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb441889-0c5e-4429-8371-3ed82686e373 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:09.826499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a2a63-ca71-414d-a20a-2cc79a782664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:09.827163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a2a63-ca71-414d-a20a-2cc79a782664 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:09.827552 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a2a63-ca71-414d-a20a-2cc79a782664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:09.828001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a2a63-ca71-414d-a20a-2cc79a782664 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:09.828562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a2a63-ca71-414d-a20a-2cc79a782664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:09:09.828890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a2a63-ca71-414d-a20a-2cc79a782664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:09.830479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a2a63-ca71-414d-a20a-2cc79a782664 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:09.847108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1106/2212] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:09:09.848905 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5be85a-7aa1-486c-b051-8bd1c33b36f7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:09.863734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5be85a-7aa1-486c-b051-8bd1c33b36f7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:09.868584 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cb3ee-cc65-4569-81f9-189eaf6e7083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:09.869252 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cb3ee-cc65-4569-81f9-189eaf6e7083 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:09.869538 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cb3ee-cc65-4569-81f9-189eaf6e7083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:09.869818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cb3ee-cc65-4569-81f9-189eaf6e7083 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:09.870522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cb3ee-cc65-4569-81f9-189eaf6e7083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:09.872607 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cb3ee-cc65-4569-81f9-189eaf6e7083 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:09.903412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1107/2213] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:09:09 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:09:09.907514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a2a63-ca71-414d-a20a-2cc79a782664 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:09.917789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a2a63-ca71-414d-a20a-2cc79a782664 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:09.973755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be167fd5-519c-4e63-868c-d07b1caf1a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:09.974431 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167fd5-519c-4e63-868c-d07b1caf1a91 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:09.974766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167fd5-519c-4e63-868c-d07b1caf1a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:09.975049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be167fd5-519c-4e63-868c-d07b1caf1a91 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:09.975781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be167fd5-519c-4e63-868c-d07b1caf1a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:09.977824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be167fd5-519c-4e63-868c-d07b1caf1a91 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:09.999325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1107/2214] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:09:09 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:09:10.003541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cb3ee-cc65-4569-81f9-189eaf6e7083 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:10.014214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cb3ee-cc65-4569-81f9-189eaf6e7083 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:10.019537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c41d0d-6c6e-407e-8e7a-d0efe5f1fd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:10.020323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c41d0d-6c6e-407e-8e7a-d0efe5f1fd26 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.020684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c41d0d-6c6e-407e-8e7a-d0efe5f1fd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.021039 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c41d0d-6c6e-407e-8e7a-d0efe5f1fd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.021840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c41d0d-6c6e-407e-8e7a-d0efe5f1fd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:10.023751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c41d0d-6c6e-407e-8e7a-d0efe5f1fd26 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:10.038610 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1108/2215] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:09:10.040322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be167fd5-519c-4e63-868c-d07b1caf1a91 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:10.051612 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be167fd5-519c-4e63-868c-d07b1caf1a91 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:10.056478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074db739-0d6a-4b5b-b985-fa52e8cb8601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:10.057139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db739-0d6a-4b5b-b985-fa52e8cb8601 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.057429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db739-0d6a-4b5b-b985-fa52e8cb8601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.057705 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db739-0d6a-4b5b-b985-fa52e8cb8601 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.058481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074db739-0d6a-4b5b-b985-fa52e8cb8601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:10.060200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074db739-0d6a-4b5b-b985-fa52e8cb8601 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:10.073754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1108/2216] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:09:10.075528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c41d0d-6c6e-407e-8e7a-d0efe5f1fd26 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:10.085386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c41d0d-6c6e-407e-8e7a-d0efe5f1fd26 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:10.090731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198db5-9038-4fbd-a19f-783710142a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:10.091624 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198db5-9038-4fbd-a19f-783710142a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.091884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198db5-9038-4fbd-a19f-783710142a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.092156 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25198db5-9038-4fbd-a19f-783710142a95 admin admin] PATH_INFO: `/v3/projects/a8797c95c4494e6c9cfe2518f7019ada/users/ce1fc863363c4a2789d0fff3b906030f/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.107690 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25198db5-9038-4fbd-a19f-783710142a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8797c95c4494e6c9cfe2518f7019ada, user_id=ce1fc863363c4a2789d0fff3b906030f, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:10.110384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25198db5-9038-4fbd-a19f-783710142a95 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:10.125095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1109/2217] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:09:10 2022] PUT /identity/v3/projects/a8797c95c4494e6c9cfe2518f7019ada/users/ce1fc863363c4a2789d0fff3b906030f/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:09:10.136348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af854fa7-5e25-4036-85b3-fc617c9df580 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.137263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af854fa7-5e25-4036-85b3-fc617c9df580 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.137547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af854fa7-5e25-4036-85b3-fc617c9df580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.169608 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-af854fa7-5e25-4036-85b3-fc617c9df580 None None] MFA Rules not processed for user `ce1fc863363c4a2789d0fff3b906030f`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:10.170750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-af854fa7-5e25-4036-85b3-fc617c9df580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:10.235595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1109/2218] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:10.240203 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198db5-9038-4fbd-a19f-783710142a95 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:10.305784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25198db5-9038-4fbd-a19f-783710142a95 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:10.310576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3638be-ec8c-4e84-b293-bdfa2b60b8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:10.311234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3638be-ec8c-4e84-b293-bdfa2b60b8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.311516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3638be-ec8c-4e84-b293-bdfa2b60b8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.311788 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3638be-ec8c-4e84-b293-bdfa2b60b8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.312509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3638be-ec8c-4e84-b293-bdfa2b60b8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:10.314473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3638be-ec8c-4e84-b293-bdfa2b60b8d2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:10.343248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1110/2219] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:09:10 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:09:10.346089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af854fa7-5e25-4036-85b3-fc617c9df580 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:10.358333 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af854fa7-5e25-4036-85b3-fc617c9df580 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:10.418649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a08d9-c935-4d59-84c5-fb9eb2232ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:10.419324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a08d9-c935-4d59-84c5-fb9eb2232ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.419657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a08d9-c935-4d59-84c5-fb9eb2232ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.419888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a08d9-c935-4d59-84c5-fb9eb2232ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.420628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a08d9-c935-4d59-84c5-fb9eb2232ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:10.422537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a08d9-c935-4d59-84c5-fb9eb2232ea4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:10.443022 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1110/2220] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:09:10 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:09:10.446993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3638be-ec8c-4e84-b293-bdfa2b60b8d2 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:10.457352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3638be-ec8c-4e84-b293-bdfa2b60b8d2 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:10.462142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e49a75-7def-476a-9b44-43c5f2ea7da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:10.462884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e49a75-7def-476a-9b44-43c5f2ea7da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.463233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e49a75-7def-476a-9b44-43c5f2ea7da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.463575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e49a75-7def-476a-9b44-43c5f2ea7da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.464419 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e49a75-7def-476a-9b44-43c5f2ea7da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:10.466608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e49a75-7def-476a-9b44-43c5f2ea7da1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:10.477080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1111/2221] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:09:10.481863 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a08d9-c935-4d59-84c5-fb9eb2232ea4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:10.491562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a08d9-c935-4d59-84c5-fb9eb2232ea4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:10.496491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab1135-5fcf-4551-81b8-15b3f11080c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:10.497322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1135-5fcf-4551-81b8-15b3f11080c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.497619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1135-5fcf-4551-81b8-15b3f11080c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.497870 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab1135-5fcf-4551-81b8-15b3f11080c4 admin admin] PATH_INFO: `/v3/projects/ff4a4470bb3845279146efeea166cb67/users/e84006811ace4bafa64204f91c5d3ad7/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.512729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab1135-5fcf-4551-81b8-15b3f11080c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4a4470bb3845279146efeea166cb67, user_id=e84006811ace4bafa64204f91c5d3ad7, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:10.515493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab1135-5fcf-4551-81b8-15b3f11080c4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:10.531181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1111/2222] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:09:10 2022] PUT /identity/v3/projects/ff4a4470bb3845279146efeea166cb67/users/e84006811ace4bafa64204f91c5d3ad7/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:10.535061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e49a75-7def-476a-9b44-43c5f2ea7da1 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:10.545055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e49a75-7def-476a-9b44-43c5f2ea7da1 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:10.605503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d819c-17a2-4efa-929a-3097a6c6f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:10.606360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d819c-17a2-4efa-929a-3097a6c6f0ce admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.606736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d819c-17a2-4efa-929a-3097a6c6f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.607176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d819c-17a2-4efa-929a-3097a6c6f0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.608000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d819c-17a2-4efa-929a-3097a6c6f0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:10.610071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d819c-17a2-4efa-929a-3097a6c6f0ce admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:10.620033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1112/2223] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:09:10.624485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab1135-5fcf-4551-81b8-15b3f11080c4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:10.634523 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab1135-5fcf-4551-81b8-15b3f11080c4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:10.641251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00593b0-edf5-4e51-8828-92b980739b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:10.642330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00593b0-edf5-4e51-8828-92b980739b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.642618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00593b0-edf5-4e51-8828-92b980739b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.642891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00593b0-edf5-4e51-8828-92b980739b58 admin admin] PATH_INFO: `/v3/projects/ff4a4470bb3845279146efeea166cb67/users/e84006811ace4bafa64204f91c5d3ad7/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.644878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00593b0-edf5-4e51-8828-92b980739b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4a4470bb3845279146efeea166cb67, user_id=e84006811ace4bafa64204f91c5d3ad7, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:10.647508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00593b0-edf5-4e51-8828-92b980739b58 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:10.658347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1112/2224] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:09:10 2022] PUT /identity/v3/projects/ff4a4470bb3845279146efeea166cb67/users/e84006811ace4bafa64204f91c5d3ad7/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:10.668523 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaf247-0669-4b9a-a630-211216baa34a None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.668888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaf247-0669-4b9a-a630-211216baa34a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.669223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaf247-0669-4b9a-a630-211216baa34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.695850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a4eaf247-0669-4b9a-a630-211216baa34a None None] MFA Rules not processed for user `e84006811ace4bafa64204f91c5d3ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:10.697107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a4eaf247-0669-4b9a-a630-211216baa34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:10.769332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1113/2225] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:09:10.780243 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00593b0-edf5-4e51-8828-92b980739b58 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:10.781932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a00593b0-edf5-4e51-8828-92b980739b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:10.842943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00593b0-edf5-4e51-8828-92b980739b58 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:10.846625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f0480-af6a-4b8e-bcec-0d91dc5cebe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:10.847273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f0480-af6a-4b8e-bcec-0d91dc5cebe7 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:10.847556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f0480-af6a-4b8e-bcec-0d91dc5cebe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:10.847832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f0480-af6a-4b8e-bcec-0d91dc5cebe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:10.908781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f0480-af6a-4b8e-bcec-0d91dc5cebe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:10.910224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f0480-af6a-4b8e-bcec-0d91dc5cebe7 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:10.920536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1113/2226] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:13.561832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaf247-0669-4b9a-a630-211216baa34a None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:13.621363 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaf247-0669-4b9a-a630-211216baa34a None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:13.625913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:13.626764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:13.627048 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:13.627325 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] PATH_INFO: `/v3/users/ce1fc863363c4a2789d0fff3b906030f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:13.628536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1fc863363c4a2789d0fff3b906030f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:13.630447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:13.675306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1fc863363c4a2789d0fff3b906030f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:13.675948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1fc863363c4a2789d0fff3b906030f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:13.682438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1fc863363c4a2789d0fff3b906030f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:13.689485 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1fc863363c4a2789d0fff3b906030f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:13.690116 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1fc863363c4a2789d0fff3b906030f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:13.707325 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1114/2227] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:09:13 2022] DELETE /identity/v3/users/ce1fc863363c4a2789d0fff3b906030f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:13.711933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87109d-4a34-4d14-9505-96dca06a3e49 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:13.712439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87109d-4a34-4d14-9505-96dca06a3e49 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:13.712542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87109d-4a34-4d14-9505-96dca06a3e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:13.729803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4a87109d-4a34-4d14-9505-96dca06a3e49 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:13.731139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4a87109d-4a34-4d14-9505-96dca06a3e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:13.789985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1114/2228] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:13.799437 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:13.800875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:13.861113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf0743-29fd-46d9-a474-a86f22bc44ce admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:13.865461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b3b42-21a1-4c34-b3f9-6cf7de5aa579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:13.866140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b3b42-21a1-4c34-b3f9-6cf7de5aa579 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:13.866438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b3b42-21a1-4c34-b3f9-6cf7de5aa579 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:13.866839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b3b42-21a1-4c34-b3f9-6cf7de5aa579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:13.877333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b3b42-21a1-4c34-b3f9-6cf7de5aa579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:13.878800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b3b42-21a1-4c34-b3f9-6cf7de5aa579 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:13.888811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1115/2229] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:14.149065 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87109d-4a34-4d14-9505-96dca06a3e49 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:14.150568 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4a87109d-4a34-4d14-9505-96dca06a3e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:14.162773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87109d-4a34-4d14-9505-96dca06a3e49 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:14.167337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:14.168363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:14.168712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:14.169310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] PATH_INFO: `/v3/projects/a8797c95c4494e6c9cfe2518f7019ada` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:14.170177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8797c95c4494e6c9cfe2518f7019ada)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:14.172218 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:14.233503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8797c95c4494e6c9cfe2518f7019ada', 'request_id': 'req-93d35399-395e-4d82-8034-8fc00f52dcd3'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.240503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8797c95c4494e6c9cfe2518f7019ada', 'request_id': 'req-93d35399-395e-4d82-8034-8fc00f52dcd3'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.246838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8797c95c4494e6c9cfe2518f7019ada', 'request_id': 'req-93d35399-395e-4d82-8034-8fc00f52dcd3'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.258832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] The token cache is being invalidate because project a8797c95c4494e6c9cfe2518f7019ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:09:14.259311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.260116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.265406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1115/2230] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:09:14 2022] DELETE /identity/v3/projects/a8797c95c4494e6c9cfe2518f7019ada => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:14.266567 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b3b42-21a1-4c34-b3f9-6cf7de5aa579 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:14.277816 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b3b42-21a1-4c34-b3f9-6cf7de5aa579 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:14.338614 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:14.339515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:14.340028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:14.340348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] PATH_INFO: `/v3/users/e84006811ace4bafa64204f91c5d3ad7` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:14.341565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84006811ace4bafa64204f91c5d3ad7)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:14.343811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:14.389559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84006811ace4bafa64204f91c5d3ad7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.390220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84006811ace4bafa64204f91c5d3ad7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.397052 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84006811ace4bafa64204f91c5d3ad7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.405047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84006811ace4bafa64204f91c5d3ad7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.405770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84006811ace4bafa64204f91c5d3ad7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.423953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1116/2231] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:09:14 2022] DELETE /identity/v3/users/e84006811ace4bafa64204f91c5d3ad7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:14.519948 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:14.524874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:14.584514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d35399-395e-4d82-8034-8fc00f52dcd3 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:14.634479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db60203-d25c-421a-be98-6b5dc601f226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:14.635121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db60203-d25c-421a-be98-6b5dc601f226 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:14.635399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db60203-d25c-421a-be98-6b5dc601f226 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:14.635670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db60203-d25c-421a-be98-6b5dc601f226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:14.637528 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6db60203-d25c-421a-be98-6b5dc601f226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:14.696140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:14.698213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:14.702804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db60203-d25c-421a-be98-6b5dc601f226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:14.703661 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db60203-d25c-421a-be98-6b5dc601f226 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:14.713732 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1116/2232] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:14.779074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f62d-07fa-471b-ac25-d78ab07086ec admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:14.784127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:14.785194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:14.785675 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:14.785957 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] PATH_INFO: `/v3/projects/ff4a4470bb3845279146efeea166cb67` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:14.787176 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4a4470bb3845279146efeea166cb67)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:14.789190 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:14.835863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4a4470bb3845279146efeea166cb67', 'request_id': 'req-9b4a9698-a495-4549-a815-5b99910c4296'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.842332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4a4470bb3845279146efeea166cb67', 'request_id': 'req-9b4a9698-a495-4549-a815-5b99910c4296'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.847673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4a4470bb3845279146efeea166cb67', 'request_id': 'req-9b4a9698-a495-4549-a815-5b99910c4296'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.860101 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] The token cache is being invalidate because project ff4a4470bb3845279146efeea166cb67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:09:14.860409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.861026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9b4a9698-a495-4549-a815-5b99910c4296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:14.862590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1117/2233] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:09:14 2022] DELETE /identity/v3/projects/ff4a4470bb3845279146efeea166cb67 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:14.867409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbbc6d-8cda-45a0-bbf0-065db9c8d358 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:14.867704 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbbc6d-8cda-45a0-bbf0-065db9c8d358 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:14.868025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbbc6d-8cda-45a0-bbf0-065db9c8d358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:14.886079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-3bfbbc6d-8cda-45a0-bbf0-065db9c8d358 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:14.887381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-3bfbbc6d-8cda-45a0-bbf0-065db9c8d358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:14.945185 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1117/2234] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:14.954346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc781-be46-4caa-b252-6caa891efcb4 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:14.954678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc781-be46-4caa-b252-6caa891efcb4 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:14.954982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc781-be46-4caa-b252-6caa891efcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:14.973921 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-086cc781-be46-4caa-b252-6caa891efcb4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:14.975292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-086cc781-be46-4caa-b252-6caa891efcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:14.984753 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1118/2235] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:14.989171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbbc6d-8cda-45a0-bbf0-065db9c8d358 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:14.999256 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbbc6d-8cda-45a0-bbf0-065db9c8d358 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:15.003976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b04938-cf50-4307-9f9c-14bb73094c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:15.004700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b04938-cf50-4307-9f9c-14bb73094c7c admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:15.004984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b04938-cf50-4307-9f9c-14bb73094c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:15.005260 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b04938-cf50-4307-9f9c-14bb73094c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:15.005984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b04938-cf50-4307-9f9c-14bb73094c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:09:15.006293 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b04938-cf50-4307-9f9c-14bb73094c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:15.007898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b04938-cf50-4307-9f9c-14bb73094c7c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:15.023250 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1118/2236] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:09:15.024464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cc781-be46-4caa-b252-6caa891efcb4 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:15.034523 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cc781-be46-4caa-b252-6caa891efcb4 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:15.039261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195cc8d-06c8-4ac9-9704-f55a2bb4f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:15.039912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195cc8d-06c8-4ac9-9704-f55a2bb4f3dc admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:15.040229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195cc8d-06c8-4ac9-9704-f55a2bb4f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:15.040516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195cc8d-06c8-4ac9-9704-f55a2bb4f3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:15.041232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195cc8d-06c8-4ac9-9704-f55a2bb4f3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:15.043372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195cc8d-06c8-4ac9-9704-f55a2bb4f3dc admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:15.069220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1119/2237] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:09:15 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:09:15.073661 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b04938-cf50-4307-9f9c-14bb73094c7c admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:15.085053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b04938-cf50-4307-9f9c-14bb73094c7c admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:15.143822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b125ffe-fa9c-43b6-a7a7-6814dcf0c424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:15.144625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125ffe-fa9c-43b6-a7a7-6814dcf0c424 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:15.144981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125ffe-fa9c-43b6-a7a7-6814dcf0c424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:15.145335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125ffe-fa9c-43b6-a7a7-6814dcf0c424 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:15.146106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b125ffe-fa9c-43b6-a7a7-6814dcf0c424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:15.148115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b125ffe-fa9c-43b6-a7a7-6814dcf0c424 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:15.170922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1119/2238] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:09:15 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:09:15.172166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195cc8d-06c8-4ac9-9704-f55a2bb4f3dc admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:15.182397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195cc8d-06c8-4ac9-9704-f55a2bb4f3dc admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:15.187263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6383a-dff6-4850-be12-90f7e8ae7131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:15.187916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6383a-dff6-4850-be12-90f7e8ae7131 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:15.188221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6383a-dff6-4850-be12-90f7e8ae7131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:15.188554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6383a-dff6-4850-be12-90f7e8ae7131 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:15.189246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6383a-dff6-4850-be12-90f7e8ae7131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:15.190847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6383a-dff6-4850-be12-90f7e8ae7131 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:15.203692 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1120/2239] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:09:15.207422 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b125ffe-fa9c-43b6-a7a7-6814dcf0c424 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:15.217845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b125ffe-fa9c-43b6-a7a7-6814dcf0c424 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:15.222453 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c29f34-8736-4302-aa4f-861f2ea4018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:15.223104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29f34-8736-4302-aa4f-861f2ea4018d admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:15.223384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29f34-8736-4302-aa4f-861f2ea4018d admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:15.223678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c29f34-8736-4302-aa4f-861f2ea4018d admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:15.224435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c29f34-8736-4302-aa4f-861f2ea4018d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:15.226046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c29f34-8736-4302-aa4f-861f2ea4018d admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:15.236204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1120/2240] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:09:15.240130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6383a-dff6-4850-be12-90f7e8ae7131 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:15.250325 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6383a-dff6-4850-be12-90f7e8ae7131 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:15.255599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc1018-a431-45ea-abbe-eb727d472879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:15.256518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1018-a431-45ea-abbe-eb727d472879 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:15.256807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1018-a431-45ea-abbe-eb727d472879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:15.257086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1018-a431-45ea-abbe-eb727d472879 admin admin] PATH_INFO: `/v3/projects/cc237f4254c0423b8bcbe3bb1862949e/users/798880850d20431a80e469297dba1968/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:15.271899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc1018-a431-45ea-abbe-eb727d472879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc237f4254c0423b8bcbe3bb1862949e, user_id=798880850d20431a80e469297dba1968, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:15.274593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc1018-a431-45ea-abbe-eb727d472879 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:15.288231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1121/2241] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:09:15 2022] PUT /identity/v3/projects/cc237f4254c0423b8bcbe3bb1862949e/users/798880850d20431a80e469297dba1968/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:15.299220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104b18-4201-415a-967b-6068e955bd22 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:15.299508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104b18-4201-415a-967b-6068e955bd22 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:15.299783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104b18-4201-415a-967b-6068e955bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:15.327504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-52104b18-4201-415a-967b-6068e955bd22 None None] MFA Rules not processed for user `798880850d20431a80e469297dba1968`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:15.328731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-52104b18-4201-415a-967b-6068e955bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:15.394595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1121/2242] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:15.407373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc1018-a431-45ea-abbe-eb727d472879 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:15.409146 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-16fc1018-a431-45ea-abbe-eb727d472879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:15.466817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc1018-a431-45ea-abbe-eb727d472879 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:15.470494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b1267-8947-41f9-b83e-206321102579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:15.471140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b1267-8947-41f9-b83e-206321102579 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:15.471420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b1267-8947-41f9-b83e-206321102579 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:15.471693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b1267-8947-41f9-b83e-206321102579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:15.480204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b1267-8947-41f9-b83e-206321102579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:15.482233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b1267-8947-41f9-b83e-206321102579 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:15.491718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1122/2243] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:18.064704 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104b18-4201-415a-967b-6068e955bd22 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:18.125129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104b18-4201-415a-967b-6068e955bd22 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:18.129586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:18.130442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:18.130725 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:18.131003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] PATH_INFO: `/v3/users/798880850d20431a80e469297dba1968` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:18.132200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=798880850d20431a80e469297dba1968)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:18.134104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:18.177994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798880850d20431a80e469297dba1968'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:18.184618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798880850d20431a80e469297dba1968'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:18.191883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798880850d20431a80e469297dba1968'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:18.192525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798880850d20431a80e469297dba1968'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:18.193154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798880850d20431a80e469297dba1968'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:18.210484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1122/2244] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:09:18 2022] DELETE /identity/v3/users/798880850d20431a80e469297dba1968 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:18.214787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a5674-fd7f-4514-b6ac-a34ec8569cea None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:18.215276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a5674-fd7f-4514-b6ac-a34ec8569cea None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:18.216141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a5674-fd7f-4514-b6ac-a34ec8569cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:18.234581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-165a5674-fd7f-4514-b6ac-a34ec8569cea None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:18.235777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-165a5674-fd7f-4514-b6ac-a34ec8569cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:18.292559 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1123/2245] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:09:18.302498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:18.303890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:18.361278 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927ed24-61f9-4513-8c78-925f24074d62 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:18.364982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5684247-3fdc-418e-ba43-d566da1b3a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:18.365627 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5684247-3fdc-418e-ba43-d566da1b3a1e service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:18.365909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5684247-3fdc-418e-ba43-d566da1b3a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:18.366186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5684247-3fdc-418e-ba43-d566da1b3a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:18.375714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5684247-3fdc-418e-ba43-d566da1b3a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:18.377181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5684247-3fdc-418e-ba43-d566da1b3a1e service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:18.386452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1123/2246] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:18.648364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a5674-fd7f-4514-b6ac-a34ec8569cea None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:18.649778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-165a5674-fd7f-4514-b6ac-a34ec8569cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:18.669009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a5674-fd7f-4514-b6ac-a34ec8569cea None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:18.673737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:18.674593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:18.674875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:18.675146 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] PATH_INFO: `/v3/projects/cc237f4254c0423b8bcbe3bb1862949e` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:18.676346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc237f4254c0423b8bcbe3bb1862949e)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:18.678279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:18.727276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc237f4254c0423b8bcbe3bb1862949e', 'request_id': 'req-89947c1a-8bd2-4fe4-ad90-e812fa819d97'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:18.734090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc237f4254c0423b8bcbe3bb1862949e', 'request_id': 'req-89947c1a-8bd2-4fe4-ad90-e812fa819d97'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:18.739523 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc237f4254c0423b8bcbe3bb1862949e', 'request_id': 'req-89947c1a-8bd2-4fe4-ad90-e812fa819d97'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:18.752238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] The token cache is being invalidate because project cc237f4254c0423b8bcbe3bb1862949e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:09:18.752528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:18.753147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-89947c1a-8bd2-4fe4-ad90-e812fa819d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:09:18.754840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1124/2247] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:09:18 2022] DELETE /identity/v3/projects/cc237f4254c0423b8bcbe3bb1862949e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:09:27.970724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5684247-3fdc-418e-ba43-d566da1b3a1e service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:09:27.972074 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d5684247-3fdc-418e-ba43-d566da1b3a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:28.058141 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5684247-3fdc-418e-ba43-d566da1b3a1e service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:09:28.117903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982714f8-7f2d-4e75-bd86-928f9621b28f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5222a62941948229324ec8c073caf86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:09:28.118557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982714f8-7f2d-4e75-bd86-928f9621b28f service placement] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:28.118833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982714f8-7f2d-4e75-bd86-928f9621b28f service placement] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:28.119105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982714f8-7f2d-4e75-bd86-928f9621b28f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:28.120892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-982714f8-7f2d-4e75-bd86-928f9621b28f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:28.132372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982714f8-7f2d-4e75-bd86-928f9621b28f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:09:28.133981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982714f8-7f2d-4e75-bd86-928f9621b28f service placement] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:09:28.144398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1124/2248] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:09:57.758081 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620ea6-a2ab-418b-9ba5-30b3765b6c71 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:09:57.758589 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620ea6-a2ab-418b-9ba5-30b3765b6c71 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:09:57.758701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620ea6-a2ab-418b-9ba5-30b3765b6c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:09:57.776695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-84620ea6-a2ab-418b-9ba5-30b3765b6c71 None None] MFA Rules not processed for user `f45cfe92bd7641b6b78b99938767bc32`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:09:57.777810 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-84620ea6-a2ab-418b-9ba5-30b3765b6c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:09:57.831445 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1125/2249] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:09:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:10:41.432683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96012d-aedc-483f-81b9-f5da30607edd None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:10:41.433200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96012d-aedc-483f-81b9-f5da30607edd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:10:41.433305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96012d-aedc-483f-81b9-f5da30607edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:10:41.495278 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-9e96012d-aedc-483f-81b9-f5da30607edd None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:10:41.496508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9e96012d-aedc-483f-81b9-f5da30607edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:10:41.567013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1125/2250] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:10:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:10:41.608161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84620ea6-a2ab-418b-9ba5-30b3765b6c71 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:10:41.609695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-84620ea6-a2ab-418b-9ba5-30b3765b6c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:10:41.697243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84620ea6-a2ab-418b-9ba5-30b3765b6c71 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:10:41.702291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bedffb-ae7c-4710-b0b8-17027103ecce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:10:41.702934 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bedffb-ae7c-4710-b0b8-17027103ecce service swift] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:10:41.703212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bedffb-ae7c-4710-b0b8-17027103ecce service swift] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:10:41.703484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bedffb-ae7c-4710-b0b8-17027103ecce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:10:41.711536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bedffb-ae7c-4710-b0b8-17027103ecce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:10:41.713128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bedffb-ae7c-4710-b0b8-17027103ecce service swift] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:10:41.721606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1126/2251] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 12:10:43.888931 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc68818-2a38-4f8e-ad6d-e016320aaccf None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:10:43.889496 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc68818-2a38-4f8e-ad6d-e016320aaccf None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:10:43.890770 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc68818-2a38-4f8e-ad6d-e016320aaccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:10:43.909963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-2bc68818-2a38-4f8e-ad6d-e016320aaccf None None] MFA Rules not processed for user `586e15d5d16543e6b70c87fbf9079e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:10:43.911153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2bc68818-2a38-4f8e-ad6d-e016320aaccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:10:43.972034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1126/2252] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:10:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:11:00.707499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5e23-6597-4d8b-844c-7c7288581061 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:00.708098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5e23-6597-4d8b-844c-7c7288581061 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:00.708098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db5e23-6597-4d8b-844c-7c7288581061 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:00.709463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1127/2253] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 12:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:11:00.715742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d25b-0b6d-4228-b9cf-955e460fe982 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:00.716371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d25b-0b6d-4228-b9cf-955e460fe982 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:00.716371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174d25b-0b6d-4228-b9cf-955e460fe982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:00.766800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-3174d25b-0b6d-4228-b9cf-955e460fe982 None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:11:00.767995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-3174d25b-0b6d-4228-b9cf-955e460fe982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:00.847109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1127/2254] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 12:11:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:11:00.859295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db5e23-6597-4d8b-844c-7c7288581061 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:00.860942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-39db5e23-6597-4d8b-844c-7c7288581061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:00.944513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db5e23-6597-4d8b-844c-7c7288581061 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:00.948659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e9154-7df3-4e4c-9360-26734acaa890 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767fe573dff349918c26995c206f2155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:00.949421 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e9154-7df3-4e4c-9360-26734acaa890 service glance] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:00.949869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e9154-7df3-4e4c-9360-26734acaa890 service glance] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:00.950305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e9154-7df3-4e4c-9360-26734acaa890 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:00.960910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e9154-7df3-4e4c-9360-26734acaa890 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:00.962341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e9154-7df3-4e4c-9360-26734acaa890 service glance] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:00.973428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1128/2255] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:11:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:11:01.048559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f280a-99f0-489b-a555-66afcba2eea9 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:01.048954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f280a-99f0-489b-a555-66afcba2eea9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:01.049401 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f280a-99f0-489b-a555-66afcba2eea9 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:01.050923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1128/2256] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 12:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 12:11:01.055922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc951f26-7de6-4358-942f-a018f38ce974 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:01.056242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc951f26-7de6-4358-942f-a018f38ce974 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:01.056526 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc951f26-7de6-4358-942f-a018f38ce974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:01.075096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-cc951f26-7de6-4358-942f-a018f38ce974 None None] MFA Rules not processed for user `95029e6140de425e86b5f9d7e2923bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:11:01.076503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-cc951f26-7de6-4358-942f-a018f38ce974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:01.140154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1129/2257] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 12:11:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:11:01.155478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f280a-99f0-489b-a555-66afcba2eea9 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:01.158271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b49f280a-99f0-489b-a555-66afcba2eea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:01.171621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f280a-99f0-489b-a555-66afcba2eea9 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:01.175125 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a19357-3b5a-4a90-b306-d0b0c15a5912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:01.175819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19357-3b5a-4a90-b306-d0b0c15a5912 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:01.176101 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19357-3b5a-4a90-b306-d0b0c15a5912 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:01.176413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19357-3b5a-4a90-b306-d0b0c15a5912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:01.183641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a19357-3b5a-4a90-b306-d0b0c15a5912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:01.185631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a19357-3b5a-4a90-b306-d0b0c15a5912 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:01.193183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1129/2258] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:11:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:11:01.275093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973cb1d-9918-4b97-b2e6-d25714a813ad None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:01.275386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973cb1d-9918-4b97-b2e6-d25714a813ad None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:01.275665 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973cb1d-9918-4b97-b2e6-d25714a813ad None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:01.277071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1130/2259] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 12:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:11:01.282336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938df8c-1a01-40e1-a31c-b47e487e532c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:01.282651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938df8c-1a01-40e1-a31c-b47e487e532c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:01.282933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938df8c-1a01-40e1-a31c-b47e487e532c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:01.301573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-d938df8c-1a01-40e1-a31c-b47e487e532c None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:11:01.302754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d938df8c-1a01-40e1-a31c-b47e487e532c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:01.312989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1130/2260] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 12:11:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:11:01.323744 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973cb1d-9918-4b97-b2e6-d25714a813ad None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:01.335447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973cb1d-9918-4b97-b2e6-d25714a813ad None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:01.339054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c6d6f-0db8-41df-9f3e-61ce40957e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:01.339720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6d6f-0db8-41df-9f3e-61ce40957e0f service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:01.340001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6d6f-0db8-41df-9f3e-61ce40957e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:01.340336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6d6f-0db8-41df-9f3e-61ce40957e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:01.350576 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c6d6f-0db8-41df-9f3e-61ce40957e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:01.352005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c6d6f-0db8-41df-9f3e-61ce40957e0f service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:01.362948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1131/2261] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:11:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:11:09.058442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65181cc0-5672-4a0e-aed4-545570ecfe54 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:09.059500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65181cc0-5672-4a0e-aed4-545570ecfe54 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:09.059610 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65181cc0-5672-4a0e-aed4-545570ecfe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:09.077561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-65181cc0-5672-4a0e-aed4-545570ecfe54 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:11:09.078754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-65181cc0-5672-4a0e-aed4-545570ecfe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:09.086073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1131/2262] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:11:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:11:09.099232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c6d6f-0db8-41df-9f3e-61ce40957e0f service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:09.111208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c6d6f-0db8-41df-9f3e-61ce40957e0f service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:09.116264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f547a-2ff0-464b-8bf0-5dcd394d5e42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:09.116909 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f547a-2ff0-464b-8bf0-5dcd394d5e42 service swift] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:09.117196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f547a-2ff0-464b-8bf0-5dcd394d5e42 service swift] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:09.117477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f547a-2ff0-464b-8bf0-5dcd394d5e42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:09.126483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f547a-2ff0-464b-8bf0-5dcd394d5e42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:09.128083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f547a-2ff0-464b-8bf0-5dcd394d5e42 service swift] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:09.136090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1132/2263] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:11:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 12:11:16.746266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65181cc0-5672-4a0e-aed4-545570ecfe54 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:16.747798 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-65181cc0-5672-4a0e-aed4-545570ecfe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:16.759388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65181cc0-5672-4a0e-aed4-545570ecfe54 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:16.763686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3b79f-7998-4f5c-a0d0-022e30907769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:16.764602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b79f-7998-4f5c-a0d0-022e30907769 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:16.764880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b79f-7998-4f5c-a0d0-022e30907769 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:16.765154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b79f-7998-4f5c-a0d0-022e30907769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:16.767082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9cd3b79f-7998-4f5c-a0d0-022e30907769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:16.782480 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3b79f-7998-4f5c-a0d0-022e30907769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:16.783938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3b79f-7998-4f5c-a0d0-022e30907769 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:16.794917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1132/2264] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:11:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:11:19.725224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f547a-2ff0-464b-8bf0-5dcd394d5e42 service swift] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:19.735240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f547a-2ff0-464b-8bf0-5dcd394d5e42 service swift] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:19.739142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc6884-5ec9-4e97-b361-e535985c23dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:19.739999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc6884-5ec9-4e97-b361-e535985c23dd service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:19.740835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc6884-5ec9-4e97-b361-e535985c23dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:19.741323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc6884-5ec9-4e97-b361-e535985c23dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:19.743153 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2cdc6884-5ec9-4e97-b361-e535985c23dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:19.757549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc6884-5ec9-4e97-b361-e535985c23dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:19.758990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc6884-5ec9-4e97-b361-e535985c23dd service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:19.770515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1133/2265] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:11:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:11:30.366353 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3b79f-7998-4f5c-a0d0-022e30907769 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:30.367841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9cd3b79f-7998-4f5c-a0d0-022e30907769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:30.381790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3b79f-7998-4f5c-a0d0-022e30907769 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:30.387243 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c0484-9ea6-42c3-8c29-e3b155db11dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:30.387873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c0484-9ea6-42c3-8c29-e3b155db11dd service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:30.388157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c0484-9ea6-42c3-8c29-e3b155db11dd service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:30.388468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c0484-9ea6-42c3-8c29-e3b155db11dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:30.390162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-337c0484-9ea6-42c3-8c29-e3b155db11dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:30.454942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c0484-9ea6-42c3-8c29-e3b155db11dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:30.456490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c0484-9ea6-42c3-8c29-e3b155db11dd service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:30.465343 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1133/2266] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:11:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:11:31.895090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc6884-5ec9-4e97-b361-e535985c23dd service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:31.896575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2cdc6884-5ec9-4e97-b361-e535985c23dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:31.960847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc6884-5ec9-4e97-b361-e535985c23dd service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:31.965327 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c4fc9-50ba-4cdc-a134-dcf697730f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:31.966189 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4fc9-50ba-4cdc-a134-dcf697730f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:31.966474 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4fc9-50ba-4cdc-a134-dcf697730f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:31.966747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c4fc9-50ba-4cdc-a134-dcf697730f2f admin admin] PATH_INFO: `/v3/users/f45cfe92bd7641b6b78b99938767bc32` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:31.967931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c4fc9-50ba-4cdc-a134-dcf697730f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45cfe92bd7641b6b78b99938767bc32)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:31.969938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c4fc9-50ba-4cdc-a134-dcf697730f2f admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:32.013635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ed3c4fc9-50ba-4cdc-a134-dcf697730f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45cfe92bd7641b6b78b99938767bc32'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:32.014287 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ed3c4fc9-50ba-4cdc-a134-dcf697730f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45cfe92bd7641b6b78b99938767bc32'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:32.021743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ed3c4fc9-50ba-4cdc-a134-dcf697730f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45cfe92bd7641b6b78b99938767bc32'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:32.028712 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ed3c4fc9-50ba-4cdc-a134-dcf697730f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45cfe92bd7641b6b78b99938767bc32'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:32.029322 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ed3c4fc9-50ba-4cdc-a134-dcf697730f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45cfe92bd7641b6b78b99938767bc32'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:32.045696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1134/2267] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:11:31 2022] DELETE /identity/v3/users/f45cfe92bd7641b6b78b99938767bc32 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:11:32.218548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c0484-9ea6-42c3-8c29-e3b155db11dd service nova] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:32.230253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c0484-9ea6-42c3-8c29-e3b155db11dd service nova] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:32.286219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:32.287096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:32.287361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:32.287636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] PATH_INFO: `/v3/projects/a69c8441974b4749bd43a2ccf3629332` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:32.288830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69c8441974b4749bd43a2ccf3629332)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:32.290734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:32.336386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69c8441974b4749bd43a2ccf3629332', 'request_id': 'req-ed97af74-aec3-4b1c-8531-71143c7ef88f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:32.343648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69c8441974b4749bd43a2ccf3629332', 'request_id': 'req-ed97af74-aec3-4b1c-8531-71143c7ef88f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:32.350222 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69c8441974b4749bd43a2ccf3629332', 'request_id': 'req-ed97af74-aec3-4b1c-8531-71143c7ef88f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:32.360676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] The token cache is being invalidate because project a69c8441974b4749bd43a2ccf3629332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:11:32.361046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:32.361684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ed97af74-aec3-4b1c-8531-71143c7ef88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:32.363261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1134/2268] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:11:32 2022] DELETE /identity/v3/projects/a69c8441974b4749bd43a2ccf3629332 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:11:32.368195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518167a-ff03-4aa0-8f80-45ff7a3d76c3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:32.368496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518167a-ff03-4aa0-8f80-45ff7a3d76c3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:32.368775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518167a-ff03-4aa0-8f80-45ff7a3d76c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:32.386964 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-d518167a-ff03-4aa0-8f80-45ff7a3d76c3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:11:32.388133 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-d518167a-ff03-4aa0-8f80-45ff7a3d76c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:32.445912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1135/2269] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:11:32.453803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9dc9-82ba-4ec3-be3b-6577d5f2ae64 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:32.454182 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9dc9-82ba-4ec3-be3b-6577d5f2ae64 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:32.454482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9dc9-82ba-4ec3-be3b-6577d5f2ae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:32.474153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4fef9dc9-82ba-4ec3-be3b-6577d5f2ae64 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:11:32.475331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4fef9dc9-82ba-4ec3-be3b-6577d5f2ae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:32.483775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1135/2270] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:11:32.488639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518167a-ff03-4aa0-8f80-45ff7a3d76c3 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:32.497982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518167a-ff03-4aa0-8f80-45ff7a3d76c3 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:32.502594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822e84b-0539-42c6-836a-78690e86fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:32.503239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822e84b-0539-42c6-836a-78690e86fd53 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:32.503518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822e84b-0539-42c6-836a-78690e86fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:32.503785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822e84b-0539-42c6-836a-78690e86fd53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:32.504541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822e84b-0539-42c6-836a-78690e86fd53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:11:32.504841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822e84b-0539-42c6-836a-78690e86fd53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:32.506422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822e84b-0539-42c6-836a-78690e86fd53 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:32.518080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1136/2271] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:11:32.522269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef9dc9-82ba-4ec3-be3b-6577d5f2ae64 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:32.531472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef9dc9-82ba-4ec3-be3b-6577d5f2ae64 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:32.536660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ac0fb-dd9a-4b3c-b41b-e01eb443748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:32.537319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ac0fb-dd9a-4b3c-b41b-e01eb443748b admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:32.537600 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ac0fb-dd9a-4b3c-b41b-e01eb443748b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:32.537872 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ac0fb-dd9a-4b3c-b41b-e01eb443748b admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:32.538566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ac0fb-dd9a-4b3c-b41b-e01eb443748b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:32.540482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ac0fb-dd9a-4b3c-b41b-e01eb443748b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:32.566172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1136/2272] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:11:32 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:11:32.570448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822e84b-0539-42c6-836a-78690e86fd53 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:32.580711 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822e84b-0539-42c6-836a-78690e86fd53 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:32.636923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab866ab6-fc12-4cf7-816b-2a97da72c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:32.637503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab866ab6-fc12-4cf7-816b-2a97da72c266 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:32.637788 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab866ab6-fc12-4cf7-816b-2a97da72c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:32.638063 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab866ab6-fc12-4cf7-816b-2a97da72c266 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:32.638832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab866ab6-fc12-4cf7-816b-2a97da72c266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:32.640789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab866ab6-fc12-4cf7-816b-2a97da72c266 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:32.661757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1137/2273] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:11:32 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:11:32.665972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ac0fb-dd9a-4b3c-b41b-e01eb443748b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:32.676141 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ac0fb-dd9a-4b3c-b41b-e01eb443748b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:32.680824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f71b6-d610-49fa-85a8-ea93a4a8f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:32.681472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f71b6-d610-49fa-85a8-ea93a4a8f6ce admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:32.681749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f71b6-d610-49fa-85a8-ea93a4a8f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:32.682020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f71b6-d610-49fa-85a8-ea93a4a8f6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:32.682747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f71b6-d610-49fa-85a8-ea93a4a8f6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:32.684368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f71b6-d610-49fa-85a8-ea93a4a8f6ce admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:32.695197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1137/2274] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:11:32.699441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab866ab6-fc12-4cf7-816b-2a97da72c266 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:32.710058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab866ab6-fc12-4cf7-816b-2a97da72c266 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:32.721501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0652f-cf3c-4e19-b33a-1fe4e11026ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:32.722283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0652f-cf3c-4e19-b33a-1fe4e11026ea admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:32.722572 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0652f-cf3c-4e19-b33a-1fe4e11026ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:32.722900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0652f-cf3c-4e19-b33a-1fe4e11026ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:32.723641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0652f-cf3c-4e19-b33a-1fe4e11026ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:32.725353 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0652f-cf3c-4e19-b33a-1fe4e11026ea admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:32.736122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1138/2275] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:11:32.740425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f71b6-d610-49fa-85a8-ea93a4a8f6ce admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:32.753027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f71b6-d610-49fa-85a8-ea93a4a8f6ce admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:32.757700 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a0229-7b30-4798-856a-e4933f8e199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:32.758578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a0229-7b30-4798-856a-e4933f8e199d admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:32.758882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a0229-7b30-4798-856a-e4933f8e199d admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:32.759157 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a0229-7b30-4798-856a-e4933f8e199d admin admin] PATH_INFO: `/v3/projects/7798175904f843eeaef6a02708ef6f12/users/6463700c33254ae4bd9e173ca987ddc8/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:32.774961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a0229-7b30-4798-856a-e4933f8e199d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7798175904f843eeaef6a02708ef6f12, user_id=6463700c33254ae4bd9e173ca987ddc8, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:32.777717 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a0229-7b30-4798-856a-e4933f8e199d admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:32.790357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1138/2276] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:11:32 2022] PUT /identity/v3/projects/7798175904f843eeaef6a02708ef6f12/users/6463700c33254ae4bd9e173ca987ddc8/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:11:32.800342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cc8c7-5551-4e2f-8c36-7d090d00dbc2 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:32.800647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cc8c7-5551-4e2f-8c36-7d090d00dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:32.800919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cc8c7-5551-4e2f-8c36-7d090d00dbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:32.828113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2f4cc8c7-5551-4e2f-8c36-7d090d00dbc2 None None] MFA Rules not processed for user `6463700c33254ae4bd9e173ca987ddc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:11:32.830002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2f4cc8c7-5551-4e2f-8c36-7d090d00dbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:32.904305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1139/2277] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:11:32.915804 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a0229-7b30-4798-856a-e4933f8e199d admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:32.917575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-258a0229-7b30-4798-856a-e4933f8e199d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:32.973910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a0229-7b30-4798-856a-e4933f8e199d admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:32.977494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60d988-6393-4f26-9d29-d6f9fc8916aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:32.978232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d988-6393-4f26-9d29-d6f9fc8916aa service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:32.978514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d988-6393-4f26-9d29-d6f9fc8916aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:32.978817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d988-6393-4f26-9d29-d6f9fc8916aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:32.987380 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60d988-6393-4f26-9d29-d6f9fc8916aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:32.988859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60d988-6393-4f26-9d29-d6f9fc8916aa service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:32.997322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1139/2278] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:11:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:11:42.017214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cc8c7-5551-4e2f-8c36-7d090d00dbc2 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:42.077462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cc8c7-5551-4e2f-8c36-7d090d00dbc2 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:42.082162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:42.082931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:42.083214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:42.083496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] PATH_INFO: `/v3/users/6463700c33254ae4bd9e173ca987ddc8` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:42.084712 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6463700c33254ae4bd9e173ca987ddc8)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:42.086643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:42.131608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6463700c33254ae4bd9e173ca987ddc8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:42.132293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6463700c33254ae4bd9e173ca987ddc8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:42.139150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6463700c33254ae4bd9e173ca987ddc8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:42.148293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6463700c33254ae4bd9e173ca987ddc8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:42.149343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6463700c33254ae4bd9e173ca987ddc8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:42.168644 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1140/2279] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:11:42 2022] DELETE /identity/v3/users/6463700c33254ae4bd9e173ca987ddc8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:11:42.173336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa9966-0ab4-4a08-b8cc-3c19f6019aae None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:42.173913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa9966-0ab4-4a08-b8cc-3c19f6019aae None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:42.173913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa9966-0ab4-4a08-b8cc-3c19f6019aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:42.192146 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-6bfa9966-0ab4-4a08-b8cc-3c19f6019aae None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:11:42.193402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6bfa9966-0ab4-4a08-b8cc-3c19f6019aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:42.253778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1140/2280] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:11:42.263429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:42.264841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:42.322278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714475e-9c59-4aa9-924e-1d0b6727b030 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:42.325894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8ab57-c0d5-4498-96f3-f5576a69be41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:42.326540 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8ab57-c0d5-4498-96f3-f5576a69be41 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:42.326821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8ab57-c0d5-4498-96f3-f5576a69be41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:42.327109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8ab57-c0d5-4498-96f3-f5576a69be41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:42.335990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8ab57-c0d5-4498-96f3-f5576a69be41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:42.337492 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8ab57-c0d5-4498-96f3-f5576a69be41 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:42.347380 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1141/2281] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:11:42.604416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa9966-0ab4-4a08-b8cc-3c19f6019aae None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:42.605972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6bfa9966-0ab4-4a08-b8cc-3c19f6019aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:42.619064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa9966-0ab4-4a08-b8cc-3c19f6019aae None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:42.623961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:42.624837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:42.625133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:42.625404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] PATH_INFO: `/v3/projects/7798175904f843eeaef6a02708ef6f12` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:42.627155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7798175904f843eeaef6a02708ef6f12)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:42.629164 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:42.674871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7798175904f843eeaef6a02708ef6f12', 'request_id': 'req-5404711a-edda-44bc-81f2-efbbc7d22223'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:42.682312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7798175904f843eeaef6a02708ef6f12', 'request_id': 'req-5404711a-edda-44bc-81f2-efbbc7d22223'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:42.689020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7798175904f843eeaef6a02708ef6f12', 'request_id': 'req-5404711a-edda-44bc-81f2-efbbc7d22223'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:42.699167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] The token cache is being invalidate because project 7798175904f843eeaef6a02708ef6f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:11:42.699447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:42.700078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:11:42.701676 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1141/2282] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:11:42 2022] DELETE /identity/v3/projects/7798175904f843eeaef6a02708ef6f12 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:11:42.959984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8ab57-c0d5-4498-96f3-f5576a69be41 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:42.961396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bff8ab57-c0d5-4498-96f3-f5576a69be41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:43.015006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8ab57-c0d5-4498-96f3-f5576a69be41 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:43.060290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dcad0-0791-48d1-a56e-60b20628705c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:43.060884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dcad0-0791-48d1-a56e-60b20628705c service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:43.061121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dcad0-0791-48d1-a56e-60b20628705c service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:43.061394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dcad0-0791-48d1-a56e-60b20628705c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:43.063819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-cb3dcad0-0791-48d1-a56e-60b20628705c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:43.119049 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dcad0-0791-48d1-a56e-60b20628705c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:43.120517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dcad0-0791-48d1-a56e-60b20628705c service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:43.129648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1142/2283] 10.222.0.58 () {60 vars in 1396 bytes} [Tue May 17 12:11:42 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:11:44.195152 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:44.196718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:44.252863 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404711a-edda-44bc-81f2-efbbc7d22223 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:44.256635 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c30a2-db87-4b8a-8263-be7dc4897aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:44.257268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c30a2-db87-4b8a-8263-be7dc4897aaa service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:44.257546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c30a2-db87-4b8a-8263-be7dc4897aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:44.257819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c30a2-db87-4b8a-8263-be7dc4897aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:44.259536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-510c30a2-db87-4b8a-8263-be7dc4897aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:44.268722 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c30a2-db87-4b8a-8263-be7dc4897aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:44.270123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c30a2-db87-4b8a-8263-be7dc4897aaa service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:44.278007 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1142/2284] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:11:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:11:46.063518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60be9c-0cc3-4625-ab0c-9d900887c8dd None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:46.063980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60be9c-0cc3-4625-ab0c-9d900887c8dd None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:46.064114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60be9c-0cc3-4625-ab0c-9d900887c8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:46.081818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-0e60be9c-0cc3-4625-ab0c-9d900887c8dd None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:11:46.083003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0e60be9c-0cc3-4625-ab0c-9d900887c8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:46.135464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1143/2285] 10.222.0.58 () {58 vars in 967 bytes} [Tue May 17 12:11:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:11:46.157636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c30a2-db87-4b8a-8263-be7dc4897aaa service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:11:46.159008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-510c30a2-db87-4b8a-8263-be7dc4897aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:11:46.229625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c30a2-db87-4b8a-8263-be7dc4897aaa service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:11:46.234636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452267d-8c25-407b-9c11-65f495580eb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:11:46.235840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452267d-8c25-407b-9c11-65f495580eb8 service swift] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:11:46.236137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452267d-8c25-407b-9c11-65f495580eb8 service swift] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:11:46.236426 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452267d-8c25-407b-9c11-65f495580eb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:11:46.244479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452267d-8c25-407b-9c11-65f495580eb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:11:46.246058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452267d-8c25-407b-9c11-65f495580eb8 service swift] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:11:46.253945 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1143/2286] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:11:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 12:12:11.951801 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0a01-0d6c-40ed-89f3-3f57b089be00 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:11.952371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0a01-0d6c-40ed-89f3-3f57b089be00 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:11.952371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0a01-0d6c-40ed-89f3-3f57b089be00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:11.971914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-202a0a01-0d6c-40ed-89f3-3f57b089be00 None None] MFA Rules not processed for user `bb9da9200f804a4a987f2cdb49f6801d`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:12:11.973135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-202a0a01-0d6c-40ed-89f3-3f57b089be00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:11.979951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1144/2287] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:12:16.843200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452267d-8c25-407b-9c11-65f495580eb8 service swift] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:12:16.845420 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-3452267d-8c25-407b-9c11-65f495580eb8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:16.928938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452267d-8c25-407b-9c11-65f495580eb8 service swift] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:12:16.934555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05505fae-1366-42b4-8913-cce85643e2d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:12:16.935201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05505fae-1366-42b4-8913-cce85643e2d8 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:16.935485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05505fae-1366-42b4-8913-cce85643e2d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:16.935763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05505fae-1366-42b4-8913-cce85643e2d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:16.937645 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-05505fae-1366-42b4-8913-cce85643e2d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:16.951549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05505fae-1366-42b4-8913-cce85643e2d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:12:16.953187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05505fae-1366-42b4-8913-cce85643e2d8 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:12:16.964582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1144/2288] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:12:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:12:33.582914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a0a01-0d6c-40ed-89f3-3f57b089be00 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:12:33.595230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a0a01-0d6c-40ed-89f3-3f57b089be00 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:12:33.601427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849917a2-32ee-4f10-97c4-f89da156c05a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:12:33.602064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849917a2-32ee-4f10-97c4-f89da156c05a service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:33.602388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849917a2-32ee-4f10-97c4-f89da156c05a service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:33.602666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849917a2-32ee-4f10-97c4-f89da156c05a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:33.604453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-849917a2-32ee-4f10-97c4-f89da156c05a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:33.660441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849917a2-32ee-4f10-97c4-f89da156c05a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:12:33.662024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849917a2-32ee-4f10-97c4-f89da156c05a service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:12:33.671107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1145/2289] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:12:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:12:39.727984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05505fae-1366-42b4-8913-cce85643e2d8 service nova] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:12:39.729479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-05505fae-1366-42b4-8913-cce85643e2d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:39.743075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05505fae-1366-42b4-8913-cce85643e2d8 service nova] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:12:39.749500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f735-c900-4402-8382-d63609e4fc0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:12:39.750083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f735-c900-4402-8382-d63609e4fc0e service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:39.750370 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f735-c900-4402-8382-d63609e4fc0e service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:39.750648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f735-c900-4402-8382-d63609e4fc0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:39.752750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d9c7f735-c900-4402-8382-d63609e4fc0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:39.812290 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f735-c900-4402-8382-d63609e4fc0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:12:39.813894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f735-c900-4402-8382-d63609e4fc0e service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:12:39.823685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1145/2290] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:12:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:12:42.888323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89106-e544-4c21-877b-1674ba25c513 None None] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:42.888910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89106-e544-4c21-877b-1674ba25c513 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:42.889017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89106-e544-4c21-877b-1674ba25c513 None None] PATH_INFO: `/` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:42.890479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1146/2291] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 12:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:12:42.897072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ead4b7-3a12-44f1-b99b-a05a7b34c165 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:42.897547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ead4b7-3a12-44f1-b99b-a05a7b34c165 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:42.897643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ead4b7-3a12-44f1-b99b-a05a7b34c165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:42.915903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e8ead4b7-3a12-44f1-b99b-a05a7b34c165 None None] MFA Rules not processed for user `95029e6140de425e86b5f9d7e2923bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:12:42.917161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e8ead4b7-3a12-44f1-b99b-a05a7b34c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:42.923667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1146/2292] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 12:12:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:12:42.938800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c89106-e544-4c21-877b-1674ba25c513 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:12:42.950359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c89106-e544-4c21-877b-1674ba25c513 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:12:42.953910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063faf8-acc5-4044-b6c2-27b5c2d363fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:12:42.954679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063faf8-acc5-4044-b6c2-27b5c2d363fe service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:42.954964 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063faf8-acc5-4044-b6c2-27b5c2d363fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:42.955306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063faf8-acc5-4044-b6c2-27b5c2d363fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:42.962598 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063faf8-acc5-4044-b6c2-27b5c2d363fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:12:42.964021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063faf8-acc5-4044-b6c2-27b5c2d363fe service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:12:42.972641 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1147/2293] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:12:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:12:43.066079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef567-5dac-4a6e-b303-76c064f5a1f5 None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:43.066377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef567-5dac-4a6e-b303-76c064f5a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:43.067457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ef567-5dac-4a6e-b303-76c064f5a1f5 None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:43.069161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1147/2294] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 12:12:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:12:43.075202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e0f4-e68f-45a7-a045-0a12aaa76b19 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:43.075565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e0f4-e68f-45a7-a045-0a12aaa76b19 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:43.075848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0e0f4-e68f-45a7-a045-0a12aaa76b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:43.096765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-71f0e0f4-e68f-45a7-a045-0a12aaa76b19 None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:12:43.098003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-71f0e0f4-e68f-45a7-a045-0a12aaa76b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:43.107317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1148/2295] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 12:12:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:12:43.118562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ef567-5dac-4a6e-b303-76c064f5a1f5 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:12:43.129579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ef567-5dac-4a6e-b303-76c064f5a1f5 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:12:43.133210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104997a-cb92-4883-8aa7-64c4eed828aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:12:43.133846 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104997a-cb92-4883-8aa7-64c4eed828aa service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:43.134131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104997a-cb92-4883-8aa7-64c4eed828aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:43.134411 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104997a-cb92-4883-8aa7-64c4eed828aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:43.144562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104997a-cb92-4883-8aa7-64c4eed828aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:12:43.145986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104997a-cb92-4883-8aa7-64c4eed828aa service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:12:43.156750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1148/2296] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:12:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:12:43.218824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e0f4-e68f-45a7-a045-0a12aaa76b19 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:12:43.220270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-71f0e0f4-e68f-45a7-a045-0a12aaa76b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:43.292912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0e0f4-e68f-45a7-a045-0a12aaa76b19 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:12:43.298254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bc05b-e09b-481a-ad3f-48fb9f400ee7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5222a62941948229324ec8c073caf86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:12:43.299015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bc05b-e09b-481a-ad3f-48fb9f400ee7 service placement] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:43.299365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bc05b-e09b-481a-ad3f-48fb9f400ee7 service placement] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:43.299693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bc05b-e09b-481a-ad3f-48fb9f400ee7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:43.301601 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-006bc05b-e09b-481a-ad3f-48fb9f400ee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:43.315327 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bc05b-e09b-481a-ad3f-48fb9f400ee7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:12:43.317097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bc05b-e09b-481a-ad3f-48fb9f400ee7 service placement] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:12:43.328433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1149/2297] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:12:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:12:45.735985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104997a-cb92-4883-8aa7-64c4eed828aa service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:12:45.757332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104997a-cb92-4883-8aa7-64c4eed828aa service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:12:45.762960 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7d55-48f0-4daf-9ff0-daae75461a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:12:45.763596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7d55-48f0-4daf-9ff0-daae75461a2b service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:45.763879 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7d55-48f0-4daf-9ff0-daae75461a2b service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:45.764326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7d55-48f0-4daf-9ff0-daae75461a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:45.766461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b79d7d55-48f0-4daf-9ff0-daae75461a2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:45.787116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7d55-48f0-4daf-9ff0-daae75461a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:12:45.789335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7d55-48f0-4daf-9ff0-daae75461a2b service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:12:45.812942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1149/2298] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:12:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:12:46.388940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bc05b-e09b-481a-ad3f-48fb9f400ee7 service placement] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:12:46.402338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bc05b-e09b-481a-ad3f-48fb9f400ee7 service placement] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:12:46.409261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa59b-97dd-492a-8221-5a4960db2804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:12:46.411386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa59b-97dd-492a-8221-5a4960db2804 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:46.411386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa59b-97dd-492a-8221-5a4960db2804 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:46.411386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa59b-97dd-492a-8221-5a4960db2804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:46.413087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a46aa59b-97dd-492a-8221-5a4960db2804 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:46.425910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa59b-97dd-492a-8221-5a4960db2804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:12:46.427654 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa59b-97dd-492a-8221-5a4960db2804 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:12:46.439452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1150/2299] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:12:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:12:50.823380 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb4cce-19c6-4dca-8137-699d5656cd8e None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:50.823936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb4cce-19c6-4dca-8137-699d5656cd8e None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:50.823936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb4cce-19c6-4dca-8137-699d5656cd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:50.842054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-9eeb4cce-19c6-4dca-8137-699d5656cd8e None None] MFA Rules not processed for user `586e15d5d16543e6b70c87fbf9079e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:12:50.843244 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9eeb4cce-19c6-4dca-8137-699d5656cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:50.850367 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1150/2300] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:12:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:12:51.145457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa59b-97dd-492a-8221-5a4960db2804 service nova] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:12:51.154416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa59b-97dd-492a-8221-5a4960db2804 service nova] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:12:51.157931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e61e8-48fe-4a93-8307-a116635aa2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:12:51.159089 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e61e8-48fe-4a93-8307-a116635aa2bd service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:12:51.159373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e61e8-48fe-4a93-8307-a116635aa2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:12:51.159650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e61e8-48fe-4a93-8307-a116635aa2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:12:51.161412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-596e61e8-48fe-4a93-8307-a116635aa2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:12:51.170670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e61e8-48fe-4a93-8307-a116635aa2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:12:51.172090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e61e8-48fe-4a93-8307-a116635aa2bd service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:12:51.180525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1151/2301] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:12:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:13:06.873494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653f1e-aca3-49e8-8737-aeb0be641af8 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:06.874097 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653f1e-aca3-49e8-8737-aeb0be641af8 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:06.874197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653f1e-aca3-49e8-8737-aeb0be641af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:06.892579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a7653f1e-aca3-49e8-8737-aeb0be641af8 None None] MFA Rules not processed for user `e8a6a76a94ca4fb197c7b1705b809c54`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:13:06.894350 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a7653f1e-aca3-49e8-8737-aeb0be641af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:06.946893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1151/2302] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:13:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:13:42.929489 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e61e8-48fe-4a93-8307-a116635aa2bd service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:42.930934 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-596e61e8-48fe-4a93-8307-a116635aa2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:42.941297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e61e8-48fe-4a93-8307-a116635aa2bd service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:42.945039 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a5c5b-d6f2-45ef-b099-41852446bbde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:42.945678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a5c5b-d6f2-45ef-b099-41852446bbde service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:42.945967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a5c5b-d6f2-45ef-b099-41852446bbde service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:42.946245 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a5c5b-d6f2-45ef-b099-41852446bbde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:42.947963 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-628a5c5b-d6f2-45ef-b099-41852446bbde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:43.008969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a5c5b-d6f2-45ef-b099-41852446bbde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:43.010406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a5c5b-d6f2-45ef-b099-41852446bbde service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:43.019958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1152/2303] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:13:46.209286 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7653f1e-aca3-49e8-8737-aeb0be641af8 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:46.210917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a7653f1e-aca3-49e8-8737-aeb0be641af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:46.225620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7653f1e-aca3-49e8-8737-aeb0be641af8 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:46.230039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee2fcf-5131-43e8-9627-0da028939dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:46.230913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee2fcf-5131-43e8-9627-0da028939dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:46.231192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee2fcf-5131-43e8-9627-0da028939dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:46.231462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee2fcf-5131-43e8-9627-0da028939dc0 admin admin] PATH_INFO: `/v3/users/bb9da9200f804a4a987f2cdb49f6801d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:46.232659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee2fcf-5131-43e8-9627-0da028939dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9da9200f804a4a987f2cdb49f6801d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:46.234549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee2fcf-5131-43e8-9627-0da028939dc0 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:46.279323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-acee2fcf-5131-43e8-9627-0da028939dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9da9200f804a4a987f2cdb49f6801d'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:46.286677 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-acee2fcf-5131-43e8-9627-0da028939dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9da9200f804a4a987f2cdb49f6801d'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:46.293829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-acee2fcf-5131-43e8-9627-0da028939dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9da9200f804a4a987f2cdb49f6801d'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:46.294449 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-acee2fcf-5131-43e8-9627-0da028939dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9da9200f804a4a987f2cdb49f6801d'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:46.295067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-acee2fcf-5131-43e8-9627-0da028939dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9da9200f804a4a987f2cdb49f6801d'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:46.312334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1152/2304] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:13:46 2022] DELETE /identity/v3/users/bb9da9200f804a4a987f2cdb49f6801d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:13:46.478962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a5c5b-d6f2-45ef-b099-41852446bbde service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:46.489699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a5c5b-d6f2-45ef-b099-41852446bbde service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:46.545552 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:46.546410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:46.546695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:46.546980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] PATH_INFO: `/v3/projects/748d013ae6664fc79a9ac23e58f642e5` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:46.548223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] RBAC: Authorizing `identity:delete_project(project_id=748d013ae6664fc79a9ac23e58f642e5)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:46.550665 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:46.595249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748d013ae6664fc79a9ac23e58f642e5', 'request_id': 'req-f978e0f7-f085-4851-9c26-783fe4c3775e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:46.602009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748d013ae6664fc79a9ac23e58f642e5', 'request_id': 'req-f978e0f7-f085-4851-9c26-783fe4c3775e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:46.607529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748d013ae6664fc79a9ac23e58f642e5', 'request_id': 'req-f978e0f7-f085-4851-9c26-783fe4c3775e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:46.619849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] The token cache is being invalidate because project 748d013ae6664fc79a9ac23e58f642e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:13:46.620161 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:46.620813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-f978e0f7-f085-4851-9c26-783fe4c3775e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:46.622387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1153/2305] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:13:46 2022] DELETE /identity/v3/projects/748d013ae6664fc79a9ac23e58f642e5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:13:46.628109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908825d9-ddd0-4879-b5af-ee7da5b76c81 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:46.628517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908825d9-ddd0-4879-b5af-ee7da5b76c81 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:46.628859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908825d9-ddd0-4879-b5af-ee7da5b76c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:46.648289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-908825d9-ddd0-4879-b5af-ee7da5b76c81 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:13:46.649484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-908825d9-ddd0-4879-b5af-ee7da5b76c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:46.708394 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1153/2306] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:13:46.716324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f7fc1-fc37-4112-ba19-dddb93ff4ee7 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:46.716630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f7fc1-fc37-4112-ba19-dddb93ff4ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:46.716903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f7fc1-fc37-4112-ba19-dddb93ff4ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:46.734975 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2d4f7fc1-fc37-4112-ba19-dddb93ff4ee7 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:13:46.736208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2d4f7fc1-fc37-4112-ba19-dddb93ff4ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:46.743954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1154/2307] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:13:46.748150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908825d9-ddd0-4879-b5af-ee7da5b76c81 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:46.758439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908825d9-ddd0-4879-b5af-ee7da5b76c81 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:46.762936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74789f6-40b9-4b4e-a181-d457b86e0e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:46.763580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74789f6-40b9-4b4e-a181-d457b86e0e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:46.763861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74789f6-40b9-4b4e-a181-d457b86e0e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:46.764135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74789f6-40b9-4b4e-a181-d457b86e0e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:46.764896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74789f6-40b9-4b4e-a181-d457b86e0e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:13:46.765202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74789f6-40b9-4b4e-a181-d457b86e0e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:46.766777 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74789f6-40b9-4b4e-a181-d457b86e0e56 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:46.778710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1154/2308] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:13:46.782870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f7fc1-fc37-4112-ba19-dddb93ff4ee7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:46.791921 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f7fc1-fc37-4112-ba19-dddb93ff4ee7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:46.796549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10a2f7-90e8-40ed-8797-af5b949e2e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:46.797186 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10a2f7-90e8-40ed-8797-af5b949e2e9e admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:46.797467 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10a2f7-90e8-40ed-8797-af5b949e2e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:46.797742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10a2f7-90e8-40ed-8797-af5b949e2e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:46.798439 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10a2f7-90e8-40ed-8797-af5b949e2e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:46.800548 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10a2f7-90e8-40ed-8797-af5b949e2e9e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:46.835911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1155/2309] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:13:46 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:13:46.840257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74789f6-40b9-4b4e-a181-d457b86e0e56 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:46.850165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74789f6-40b9-4b4e-a181-d457b86e0e56 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:46.905237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2733292-b7c9-4b66-b5c0-d2b7584adc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:46.905904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2733292-b7c9-4b66-b5c0-d2b7584adc0a admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:46.906187 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2733292-b7c9-4b66-b5c0-d2b7584adc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:46.906461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2733292-b7c9-4b66-b5c0-d2b7584adc0a admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:46.907150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2733292-b7c9-4b66-b5c0-d2b7584adc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:46.909167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2733292-b7c9-4b66-b5c0-d2b7584adc0a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:46.928460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1155/2310] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:13:46 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:13:46.932418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10a2f7-90e8-40ed-8797-af5b949e2e9e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:46.943155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10a2f7-90e8-40ed-8797-af5b949e2e9e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:46.947758 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446bde7-23a2-4ef3-9faa-6bc6fa9fca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:46.948766 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446bde7-23a2-4ef3-9faa-6bc6fa9fca01 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:46.949047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446bde7-23a2-4ef3-9faa-6bc6fa9fca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:46.949321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446bde7-23a2-4ef3-9faa-6bc6fa9fca01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:46.950041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446bde7-23a2-4ef3-9faa-6bc6fa9fca01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:46.951658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446bde7-23a2-4ef3-9faa-6bc6fa9fca01 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:46.962396 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1156/2311] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:13:46.966391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2733292-b7c9-4b66-b5c0-d2b7584adc0a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:46.976406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2733292-b7c9-4b66-b5c0-d2b7584adc0a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:46.981018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00f3e5-12e0-4547-a97e-43c1ea85d8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:46.981665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f3e5-12e0-4547-a97e-43c1ea85d8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:46.981949 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f3e5-12e0-4547-a97e-43c1ea85d8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:46.982226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f3e5-12e0-4547-a97e-43c1ea85d8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:46.982978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00f3e5-12e0-4547-a97e-43c1ea85d8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:46.984621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00f3e5-12e0-4547-a97e-43c1ea85d8b4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:46.994728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1156/2312] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:13:46.998842 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446bde7-23a2-4ef3-9faa-6bc6fa9fca01 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:47.008984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446bde7-23a2-4ef3-9faa-6bc6fa9fca01 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:47.013530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9a2a3-6111-45db-ab4b-5e2f573eb851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:47.014390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9a2a3-6111-45db-ab4b-5e2f573eb851 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:47.014694 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9a2a3-6111-45db-ab4b-5e2f573eb851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:47.014966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9a2a3-6111-45db-ab4b-5e2f573eb851 admin admin] PATH_INFO: `/v3/projects/0f2278ac9d4a4eb79b093836acd7d135/users/3cd6ae61ab5a49038d75df60a1dd079e/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:47.029356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9a2a3-6111-45db-ab4b-5e2f573eb851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2278ac9d4a4eb79b093836acd7d135, user_id=3cd6ae61ab5a49038d75df60a1dd079e, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:47.032042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9a2a3-6111-45db-ab4b-5e2f573eb851 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:47.045519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1157/2313] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:13:46 2022] PUT /identity/v3/projects/0f2278ac9d4a4eb79b093836acd7d135/users/3cd6ae61ab5a49038d75df60a1dd079e/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:13:47.056137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e2d2-d189-4d46-9d7a-feea76de632d None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:47.056638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e2d2-d189-4d46-9d7a-feea76de632d None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:47.056919 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e2d2-d189-4d46-9d7a-feea76de632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:47.083130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-5403e2d2-d189-4d46-9d7a-feea76de632d None None] MFA Rules not processed for user `3cd6ae61ab5a49038d75df60a1dd079e`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:13:47.084341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5403e2d2-d189-4d46-9d7a-feea76de632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:47.144848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1157/2314] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:13:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:13:47.155499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9a2a3-6111-45db-ab4b-5e2f573eb851 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:47.157247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0dd9a2a3-6111-45db-ab4b-5e2f573eb851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:47.212232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9a2a3-6111-45db-ab4b-5e2f573eb851 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:47.215756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb70905-102a-462d-b99b-a0b331675397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:47.216453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb70905-102a-462d-b99b-a0b331675397 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:47.216739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb70905-102a-462d-b99b-a0b331675397 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:47.217014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb70905-102a-462d-b99b-a0b331675397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:47.225255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb70905-102a-462d-b99b-a0b331675397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:47.226679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb70905-102a-462d-b99b-a0b331675397 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:47.235278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1158/2315] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:13:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:13:55.459408 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e2d2-d189-4d46-9d7a-feea76de632d None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:55.520123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e2d2-d189-4d46-9d7a-feea76de632d None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:55.524661 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:55.525520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:55.525806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:55.526077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] PATH_INFO: `/v3/users/3cd6ae61ab5a49038d75df60a1dd079e` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:55.527272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd6ae61ab5a49038d75df60a1dd079e)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:55.529232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:55.574746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd6ae61ab5a49038d75df60a1dd079e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:55.581409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd6ae61ab5a49038d75df60a1dd079e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:55.588460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd6ae61ab5a49038d75df60a1dd079e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:55.589125 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd6ae61ab5a49038d75df60a1dd079e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:55.589746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd6ae61ab5a49038d75df60a1dd079e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:55.607030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1158/2316] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:13:55 2022] DELETE /identity/v3/users/3cd6ae61ab5a49038d75df60a1dd079e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:13:55.612205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3184c-7258-4fd9-8964-febac4055c38 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:55.612706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3184c-7258-4fd9-8964-febac4055c38 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:55.612827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3184c-7258-4fd9-8964-febac4055c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:55.629492 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c9c3184c-7258-4fd9-8964-febac4055c38 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:13:55.630677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c9c3184c-7258-4fd9-8964-febac4055c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:55.687402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1159/2317] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:13:55.697602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:55.699296 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:55.755282 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a8f2c-7d29-4e09-b371-07bcda3b3e1a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:55.759015 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394003b-50b3-45cb-86f1-2cf15ab1b0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:55.759657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394003b-50b3-45cb-86f1-2cf15ab1b0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:55.759937 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394003b-50b3-45cb-86f1-2cf15ab1b0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:55.760237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394003b-50b3-45cb-86f1-2cf15ab1b0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:55.769399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394003b-50b3-45cb-86f1-2cf15ab1b0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:55.770819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394003b-50b3-45cb-86f1-2cf15ab1b0d3 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:55.780017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1159/2318] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:13:56.038285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3184c-7258-4fd9-8964-febac4055c38 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.039686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c9c3184c-7258-4fd9-8964-febac4055c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:56.052135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3184c-7258-4fd9-8964-febac4055c38 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:56.057372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:56.057597 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.057839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.058115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] PATH_INFO: `/v3/projects/0f2278ac9d4a4eb79b093836acd7d135` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.059313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2278ac9d4a4eb79b093836acd7d135)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:56.061410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:56.116112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2278ac9d4a4eb79b093836acd7d135', 'request_id': 'req-543e24f5-b25d-4331-934e-edb0e606d482'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:56.122075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2278ac9d4a4eb79b093836acd7d135', 'request_id': 'req-543e24f5-b25d-4331-934e-edb0e606d482'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:56.127292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2278ac9d4a4eb79b093836acd7d135', 'request_id': 'req-543e24f5-b25d-4331-934e-edb0e606d482'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:56.138865 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] The token cache is being invalidate because project 0f2278ac9d4a4eb79b093836acd7d135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:13:56.139152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:56.139781 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-543e24f5-b25d-4331-934e-edb0e606d482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:13:56.141430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1160/2319] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:13:56 2022] DELETE /identity/v3/projects/0f2278ac9d4a4eb79b093836acd7d135 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:13:56.146460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8cc51-6465-4560-963b-39cdfa2fb33e None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.146753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8cc51-6465-4560-963b-39cdfa2fb33e None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.147029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8cc51-6465-4560-963b-39cdfa2fb33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.164852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-efc8cc51-6465-4560-963b-39cdfa2fb33e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:13:56.166058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-efc8cc51-6465-4560-963b-39cdfa2fb33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:56.223692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1160/2320] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:13:56.232470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8717d7f-71a8-4207-a7a1-76cfc4b94bc7 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.232762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8717d7f-71a8-4207-a7a1-76cfc4b94bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.233042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8717d7f-71a8-4207-a7a1-76cfc4b94bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.251339 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c8717d7f-71a8-4207-a7a1-76cfc4b94bc7 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:13:56.252668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c8717d7f-71a8-4207-a7a1-76cfc4b94bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:56.260544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1161/2321] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:13:56.264489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8cc51-6465-4560-963b-39cdfa2fb33e None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.274443 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8cc51-6465-4560-963b-39cdfa2fb33e None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:56.278994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f43eb3-48a0-4b5f-aeef-5bb5644ea738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:56.279633 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43eb3-48a0-4b5f-aeef-5bb5644ea738 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.279912 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43eb3-48a0-4b5f-aeef-5bb5644ea738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.280204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43eb3-48a0-4b5f-aeef-5bb5644ea738 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.280991 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f43eb3-48a0-4b5f-aeef-5bb5644ea738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:13:56.281297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f43eb3-48a0-4b5f-aeef-5bb5644ea738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:56.283403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f43eb3-48a0-4b5f-aeef-5bb5644ea738 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:56.294617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1161/2322] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:13:56.299353 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8717d7f-71a8-4207-a7a1-76cfc4b94bc7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.308326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8717d7f-71a8-4207-a7a1-76cfc4b94bc7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:56.313080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a286e5-dc3a-476c-b024-7d0e617a3b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:56.313721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a286e5-dc3a-476c-b024-7d0e617a3b1a admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.314059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a286e5-dc3a-476c-b024-7d0e617a3b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.314336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a286e5-dc3a-476c-b024-7d0e617a3b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.315041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a286e5-dc3a-476c-b024-7d0e617a3b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:56.316988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a286e5-dc3a-476c-b024-7d0e617a3b1a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:56.341573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1162/2323] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:13:56 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:13:56.346288 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f43eb3-48a0-4b5f-aeef-5bb5644ea738 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.356541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f43eb3-48a0-4b5f-aeef-5bb5644ea738 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:56.414042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8a827-2e7c-4cb4-b04f-dda5314eef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:56.414710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a827-2e7c-4cb4-b04f-dda5314eef59 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.414990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a827-2e7c-4cb4-b04f-dda5314eef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.415263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8a827-2e7c-4cb4-b04f-dda5314eef59 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.415957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8a827-2e7c-4cb4-b04f-dda5314eef59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:56.417898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8a827-2e7c-4cb4-b04f-dda5314eef59 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:56.438341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1162/2324] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:13:56 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:13:56.442702 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a286e5-dc3a-476c-b024-7d0e617a3b1a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.453095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a286e5-dc3a-476c-b024-7d0e617a3b1a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:56.458342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89a22b-bae3-4a3d-b963-9a32d0486089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:56.458989 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89a22b-bae3-4a3d-b963-9a32d0486089 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.459268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89a22b-bae3-4a3d-b963-9a32d0486089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.459540 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89a22b-bae3-4a3d-b963-9a32d0486089 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.460292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89a22b-bae3-4a3d-b963-9a32d0486089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:56.461882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89a22b-bae3-4a3d-b963-9a32d0486089 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:56.472534 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1163/2325] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:13:56.476492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8a827-2e7c-4cb4-b04f-dda5314eef59 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.486204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8a827-2e7c-4cb4-b04f-dda5314eef59 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:56.490869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd17fa-a820-4d0e-a8ed-60bcad40db14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:56.491543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd17fa-a820-4d0e-a8ed-60bcad40db14 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.491824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd17fa-a820-4d0e-a8ed-60bcad40db14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.492100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd17fa-a820-4d0e-a8ed-60bcad40db14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.492852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd17fa-a820-4d0e-a8ed-60bcad40db14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:56.494421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd17fa-a820-4d0e-a8ed-60bcad40db14 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:56.504723 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1163/2326] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:13:56.508711 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89a22b-bae3-4a3d-b963-9a32d0486089 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.519099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89a22b-bae3-4a3d-b963-9a32d0486089 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:56.523767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d1712-2fa9-40ab-9a9f-060b19bf8b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:56.524686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d1712-2fa9-40ab-9a9f-060b19bf8b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.524999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d1712-2fa9-40ab-9a9f-060b19bf8b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.525275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d1712-2fa9-40ab-9a9f-060b19bf8b5b admin admin] PATH_INFO: `/v3/projects/71c9ff2b6db64019ad8149a2cd9541d2/users/18c0292e85cc4257b22562b4b86d34cf/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.540391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d1712-2fa9-40ab-9a9f-060b19bf8b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c9ff2b6db64019ad8149a2cd9541d2, user_id=18c0292e85cc4257b22562b4b86d34cf, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:56.543032 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d1712-2fa9-40ab-9a9f-060b19bf8b5b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:56.556507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1164/2327] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:13:56 2022] PUT /identity/v3/projects/71c9ff2b6db64019ad8149a2cd9541d2/users/18c0292e85cc4257b22562b4b86d34cf/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:13:56.566869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aef63-8af8-44a9-82b8-97d08543a2f8 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.567159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aef63-8af8-44a9-82b8-97d08543a2f8 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.567434 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aef63-8af8-44a9-82b8-97d08543a2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.595559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-de2aef63-8af8-44a9-82b8-97d08543a2f8 None None] MFA Rules not processed for user `18c0292e85cc4257b22562b4b86d34cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:13:56.597404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-de2aef63-8af8-44a9-82b8-97d08543a2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:56.657475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1164/2328] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:13:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:13:56.662524 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d1712-2fa9-40ab-9a9f-060b19bf8b5b admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.722735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d1712-2fa9-40ab-9a9f-060b19bf8b5b admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:56.727678 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67190f-9c43-438f-936d-5c1f65bb10cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:56.728319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67190f-9c43-438f-936d-5c1f65bb10cb admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.728605 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67190f-9c43-438f-936d-5c1f65bb10cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.728880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67190f-9c43-438f-936d-5c1f65bb10cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.729587 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67190f-9c43-438f-936d-5c1f65bb10cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:56.731503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67190f-9c43-438f-936d-5c1f65bb10cb admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:56.757890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1165/2329] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:13:56 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:13:56.761986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2aef63-8af8-44a9-82b8-97d08543a2f8 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.773295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2aef63-8af8-44a9-82b8-97d08543a2f8 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:56.827603 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd67562-c90d-417a-b319-674c76835e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:56.828301 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd67562-c90d-417a-b319-674c76835e53 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.828588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd67562-c90d-417a-b319-674c76835e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.828866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd67562-c90d-417a-b319-674c76835e53 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.829549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd67562-c90d-417a-b319-674c76835e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:56.832296 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd67562-c90d-417a-b319-674c76835e53 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:56.851277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1165/2330] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:13:56 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:13:56.855277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67190f-9c43-438f-936d-5c1f65bb10cb admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.865455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67190f-9c43-438f-936d-5c1f65bb10cb admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:56.870679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cce20-f6c1-4bf4-a5c8-d9735c990f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:56.871343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cce20-f6c1-4bf4-a5c8-d9735c990f15 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.871626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cce20-f6c1-4bf4-a5c8-d9735c990f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.871904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cce20-f6c1-4bf4-a5c8-d9735c990f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.872668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cce20-f6c1-4bf4-a5c8-d9735c990f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:56.874452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cce20-f6c1-4bf4-a5c8-d9735c990f15 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:56.886462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1166/2331] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:13:56.890659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd67562-c90d-417a-b319-674c76835e53 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.901321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd67562-c90d-417a-b319-674c76835e53 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:56.905894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78554829-3ded-41e8-86d8-c0beb7fb082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:56.906754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554829-3ded-41e8-86d8-c0beb7fb082d admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:56.907028 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554829-3ded-41e8-86d8-c0beb7fb082d admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:56.907295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554829-3ded-41e8-86d8-c0beb7fb082d admin admin] PATH_INFO: `/v3/projects/9084c1320f3041c7b4fabfc0923ccac3/users/442bce49b81543509220e84d3f298933/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:56.921279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78554829-3ded-41e8-86d8-c0beb7fb082d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9084c1320f3041c7b4fabfc0923ccac3, user_id=442bce49b81543509220e84d3f298933, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:56.923887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78554829-3ded-41e8-86d8-c0beb7fb082d admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:56.937471 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1166/2332] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:13:56 2022] PUT /identity/v3/projects/9084c1320f3041c7b4fabfc0923ccac3/users/442bce49b81543509220e84d3f298933/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:13:56.941994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cce20-f6c1-4bf4-a5c8-d9735c990f15 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:56.952452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cce20-f6c1-4bf4-a5c8-d9735c990f15 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:57.006493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49345036-7e7e-4be4-aeb4-0c7a635c96e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:57.007126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345036-7e7e-4be4-aeb4-0c7a635c96e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:57.007413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345036-7e7e-4be4-aeb4-0c7a635c96e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:57.007679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345036-7e7e-4be4-aeb4-0c7a635c96e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:57.008430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49345036-7e7e-4be4-aeb4-0c7a635c96e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:57.010010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49345036-7e7e-4be4-aeb4-0c7a635c96e9 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:57.020005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1167/2333] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:13:57.024142 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78554829-3ded-41e8-86d8-c0beb7fb082d admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:57.034108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78554829-3ded-41e8-86d8-c0beb7fb082d admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:57.038809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4e82e-117c-4c88-906f-8679579c8fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:57.039694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e82e-117c-4c88-906f-8679579c8fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:57.039970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e82e-117c-4c88-906f-8679579c8fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:57.040303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4e82e-117c-4c88-906f-8679579c8fe4 admin admin] PATH_INFO: `/v3/projects/9084c1320f3041c7b4fabfc0923ccac3/users/442bce49b81543509220e84d3f298933/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:57.042279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4e82e-117c-4c88-906f-8679579c8fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9084c1320f3041c7b4fabfc0923ccac3, user_id=442bce49b81543509220e84d3f298933, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:57.044941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4e82e-117c-4c88-906f-8679579c8fe4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:57.055183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1167/2334] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:13:57 2022] PUT /identity/v3/projects/9084c1320f3041c7b4fabfc0923ccac3/users/442bce49b81543509220e84d3f298933/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:13:57.065308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388eb10-b5a5-4566-9933-79c977f2901c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:57.066119 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388eb10-b5a5-4566-9933-79c977f2901c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:57.066391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388eb10-b5a5-4566-9933-79c977f2901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:57.095468 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-3388eb10-b5a5-4566-9933-79c977f2901c None None] MFA Rules not processed for user `442bce49b81543509220e84d3f298933`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:13:57.096880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3388eb10-b5a5-4566-9933-79c977f2901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:57.161666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1168/2335] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:13:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:13:57.173081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4e82e-117c-4c88-906f-8679579c8fe4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:57.175333 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5ac4e82e-117c-4c88-906f-8679579c8fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:13:57.230604 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4e82e-117c-4c88-906f-8679579c8fe4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:57.234191 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f30e03-9e59-4822-9de5-3fc3718cd23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:57.234813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f30e03-9e59-4822-9de5-3fc3718cd23f service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:57.235092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f30e03-9e59-4822-9de5-3fc3718cd23f service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:57.235390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f30e03-9e59-4822-9de5-3fc3718cd23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:57.244707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f30e03-9e59-4822-9de5-3fc3718cd23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:57.246123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f30e03-9e59-4822-9de5-3fc3718cd23f service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:57.256027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1168/2336] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:13:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:13:57.326004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388eb10-b5a5-4566-9933-79c977f2901c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:13:57.335464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388eb10-b5a5-4566-9933-79c977f2901c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:13:57.339083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8d777-07b9-462d-a654-512e4a32b17f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:13:57.339715 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8d777-07b9-462d-a654-512e4a32b17f service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:13:57.339997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8d777-07b9-462d-a654-512e4a32b17f service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:13:57.340309 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8d777-07b9-462d-a654-512e4a32b17f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:13:57.394615 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8d777-07b9-462d-a654-512e4a32b17f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:13:57.396054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8d777-07b9-462d-a654-512e4a32b17f service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:13:57.404657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1169/2337] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:13:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:14:00.063946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f30e03-9e59-4822-9de5-3fc3718cd23f service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:00.124834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f30e03-9e59-4822-9de5-3fc3718cd23f service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:00.129334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:00.130191 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:00.130474 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:00.130751 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] PATH_INFO: `/v3/users/18c0292e85cc4257b22562b4b86d34cf` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:00.131928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c0292e85cc4257b22562b4b86d34cf)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:00.133883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:00.178311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c0292e85cc4257b22562b4b86d34cf'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.185077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c0292e85cc4257b22562b4b86d34cf'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.192156 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c0292e85cc4257b22562b4b86d34cf'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.192802 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c0292e85cc4257b22562b4b86d34cf'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.193440 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c0292e85cc4257b22562b4b86d34cf'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.210865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1169/2338] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:14:00 2022] DELETE /identity/v3/users/18c0292e85cc4257b22562b4b86d34cf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:00.215371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dcde0-a420-4edf-a904-937dc91d222c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:00.215877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dcde0-a420-4edf-a904-937dc91d222c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:00.216078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dcde0-a420-4edf-a904-937dc91d222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:00.233382 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c01dcde0-a420-4edf-a904-937dc91d222c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:00.234593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c01dcde0-a420-4edf-a904-937dc91d222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:00.291835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1170/2339] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:14:00.302377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:00.303762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:00.359352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9de89-76f7-4134-86aa-34797295b972 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:00.363796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4aec0-7c65-4fa7-9ac5-b8540f149d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:00.364473 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4aec0-7c65-4fa7-9ac5-b8540f149d8b service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:00.364755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4aec0-7c65-4fa7-9ac5-b8540f149d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:00.365027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4aec0-7c65-4fa7-9ac5-b8540f149d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:00.374099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4aec0-7c65-4fa7-9ac5-b8540f149d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:00.375524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4aec0-7c65-4fa7-9ac5-b8540f149d8b service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:00.385803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1170/2340] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:14:00.639622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dcde0-a420-4edf-a904-937dc91d222c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:00.641057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c01dcde0-a420-4edf-a904-937dc91d222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:00.654647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dcde0-a420-4edf-a904-937dc91d222c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:00.659295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:00.660192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:00.660485 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:00.660760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] PATH_INFO: `/v3/projects/71c9ff2b6db64019ad8149a2cd9541d2` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:00.661956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c9ff2b6db64019ad8149a2cd9541d2)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:00.663900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:00.710205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c9ff2b6db64019ad8149a2cd9541d2', 'request_id': 'req-4c16d615-2ce9-461e-a1b6-14f87448aebc'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.716139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c9ff2b6db64019ad8149a2cd9541d2', 'request_id': 'req-4c16d615-2ce9-461e-a1b6-14f87448aebc'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.721433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c9ff2b6db64019ad8149a2cd9541d2', 'request_id': 'req-4c16d615-2ce9-461e-a1b6-14f87448aebc'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.733676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] The token cache is being invalidate because project 71c9ff2b6db64019ad8149a2cd9541d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:14:00.733902 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.734519 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.736040 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1171/2341] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:14:00 2022] DELETE /identity/v3/projects/71c9ff2b6db64019ad8149a2cd9541d2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:00.740084 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4aec0-7c65-4fa7-9ac5-b8540f149d8b service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:00.749572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4aec0-7c65-4fa7-9ac5-b8540f149d8b service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:00.804122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037cdba-3805-4c06-a5be-a7abf6225535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:00.805016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037cdba-3805-4c06-a5be-a7abf6225535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:00.805300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037cdba-3805-4c06-a5be-a7abf6225535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:00.805577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037cdba-3805-4c06-a5be-a7abf6225535 admin admin] PATH_INFO: `/v3/users/442bce49b81543509220e84d3f298933` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:00.806756 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037cdba-3805-4c06-a5be-a7abf6225535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=442bce49b81543509220e84d3f298933)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:00.808697 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037cdba-3805-4c06-a5be-a7abf6225535 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:00.852812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2037cdba-3805-4c06-a5be-a7abf6225535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442bce49b81543509220e84d3f298933'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.859325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2037cdba-3805-4c06-a5be-a7abf6225535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442bce49b81543509220e84d3f298933'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.867068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2037cdba-3805-4c06-a5be-a7abf6225535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442bce49b81543509220e84d3f298933'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.867678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2037cdba-3805-4c06-a5be-a7abf6225535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442bce49b81543509220e84d3f298933'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.868357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2037cdba-3805-4c06-a5be-a7abf6225535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442bce49b81543509220e84d3f298933'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:00.885233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1171/2342] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:14:00 2022] DELETE /identity/v3/users/442bce49b81543509220e84d3f298933 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:01.149910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:01.151370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:01.165934 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16d615-2ce9-461e-a1b6-14f87448aebc admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:01.223608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:01.224502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.224784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.225057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] PATH_INFO: `/v3/projects/9084c1320f3041c7b4fabfc0923ccac3` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.226271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9084c1320f3041c7b4fabfc0923ccac3)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:01.228200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:01.274059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9084c1320f3041c7b4fabfc0923ccac3', 'request_id': 'req-dcef87be-4a74-4694-bcf0-7274b479e820'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:01.279932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9084c1320f3041c7b4fabfc0923ccac3', 'request_id': 'req-dcef87be-4a74-4694-bcf0-7274b479e820'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:01.285758 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9084c1320f3041c7b4fabfc0923ccac3', 'request_id': 'req-dcef87be-4a74-4694-bcf0-7274b479e820'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:01.297086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] The token cache is being invalidate because project 9084c1320f3041c7b4fabfc0923ccac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:14:01.297372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:01.297991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-dcef87be-4a74-4694-bcf0-7274b479e820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:01.299521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1172/2343] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:14:01 2022] DELETE /identity/v3/projects/9084c1320f3041c7b4fabfc0923ccac3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:01.305090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43c4c-af7c-407e-885b-13b8a3047649 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.305573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43c4c-af7c-407e-885b-13b8a3047649 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.305672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a43c4c-af7c-407e-885b-13b8a3047649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.323287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-51a43c4c-af7c-407e-885b-13b8a3047649 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:01.324778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-51a43c4c-af7c-407e-885b-13b8a3047649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:01.383488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1172/2344] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:01.392714 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813680f-090c-4c84-8247-77fdfc20dae6 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.393002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813680f-090c-4c84-8247-77fdfc20dae6 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.394383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813680f-090c-4c84-8247-77fdfc20dae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.412033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-4813680f-090c-4c84-8247-77fdfc20dae6 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:01.413284 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4813680f-090c-4c84-8247-77fdfc20dae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:01.421031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1173/2345] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:01.425624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43c4c-af7c-407e-885b-13b8a3047649 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:01.435078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a43c4c-af7c-407e-885b-13b8a3047649 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:01.439581 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27ded5-9f55-4d61-bd85-ad4a5e81034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:01.440259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ded5-9f55-4d61-bd85-ad4a5e81034a admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.441072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ded5-9f55-4d61-bd85-ad4a5e81034a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.441350 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ded5-9f55-4d61-bd85-ad4a5e81034a admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.442075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27ded5-9f55-4d61-bd85-ad4a5e81034a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:14:01.442384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27ded5-9f55-4d61-bd85-ad4a5e81034a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:01.443977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27ded5-9f55-4d61-bd85-ad4a5e81034a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:01.455565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1173/2346] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:14:01.460585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813680f-090c-4c84-8247-77fdfc20dae6 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:01.469481 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813680f-090c-4c84-8247-77fdfc20dae6 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:01.474049 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051090b-a484-4fb0-9a8e-7b40c6c694cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:01.474684 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051090b-a484-4fb0-9a8e-7b40c6c694cb admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.474965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051090b-a484-4fb0-9a8e-7b40c6c694cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.475239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051090b-a484-4fb0-9a8e-7b40c6c694cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.475922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051090b-a484-4fb0-9a8e-7b40c6c694cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:01.477976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051090b-a484-4fb0-9a8e-7b40c6c694cb admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:01.506274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1174/2347] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:14:01 2022] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:14:01.507630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27ded5-9f55-4d61-bd85-ad4a5e81034a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:01.517563 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27ded5-9f55-4d61-bd85-ad4a5e81034a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:01.578763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490255ad-5d41-48de-b12c-50d51afb0190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:01.579429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490255ad-5d41-48de-b12c-50d51afb0190 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.579712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490255ad-5d41-48de-b12c-50d51afb0190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.580021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490255ad-5d41-48de-b12c-50d51afb0190 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.580731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490255ad-5d41-48de-b12c-50d51afb0190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:01.583181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490255ad-5d41-48de-b12c-50d51afb0190 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:01.603011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1174/2348] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:14:01 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:14:01.607126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051090b-a484-4fb0-9a8e-7b40c6c694cb admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:01.617235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051090b-a484-4fb0-9a8e-7b40c6c694cb admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:01.621780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27a008-abc2-4036-94f4-8ffe61cbda56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:01.622431 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27a008-abc2-4036-94f4-8ffe61cbda56 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.622714 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27a008-abc2-4036-94f4-8ffe61cbda56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.622989 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27a008-abc2-4036-94f4-8ffe61cbda56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.623709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27a008-abc2-4036-94f4-8ffe61cbda56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:01.625330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27a008-abc2-4036-94f4-8ffe61cbda56 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:01.635828 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1175/2349] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:14:01.639550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490255ad-5d41-48de-b12c-50d51afb0190 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:01.649838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490255ad-5d41-48de-b12c-50d51afb0190 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:01.654466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f52063-5cd0-4de3-bf6f-4bdc0ae03e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:01.655105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52063-5cd0-4de3-bf6f-4bdc0ae03e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.655388 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52063-5cd0-4de3-bf6f-4bdc0ae03e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.655665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f52063-5cd0-4de3-bf6f-4bdc0ae03e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.656609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f52063-5cd0-4de3-bf6f-4bdc0ae03e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:01.658032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f52063-5cd0-4de3-bf6f-4bdc0ae03e37 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:01.667765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1175/2350] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:14:01.671707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27a008-abc2-4036-94f4-8ffe61cbda56 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:01.681778 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27a008-abc2-4036-94f4-8ffe61cbda56 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:01.686334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f391480-5945-4a54-a3dd-83fd8ffcdbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:01.687197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f391480-5945-4a54-a3dd-83fd8ffcdbf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.687480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f391480-5945-4a54-a3dd-83fd8ffcdbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.687754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f391480-5945-4a54-a3dd-83fd8ffcdbf5 admin admin] PATH_INFO: `/v3/projects/dba7d0b4f9ff48bb9da2fd03d3575afd/users/8dd5d5cb0b45472f82e55f9c567c3bc3/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.703039 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f391480-5945-4a54-a3dd-83fd8ffcdbf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba7d0b4f9ff48bb9da2fd03d3575afd, user_id=8dd5d5cb0b45472f82e55f9c567c3bc3, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:01.705716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f391480-5945-4a54-a3dd-83fd8ffcdbf5 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:01.717896 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1176/2351] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:14:01 2022] PUT /identity/v3/projects/dba7d0b4f9ff48bb9da2fd03d3575afd/users/8dd5d5cb0b45472f82e55f9c567c3bc3/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:14:01.728200 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd755d8-2f4e-42b7-89b6-072e5835e75b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.728505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd755d8-2f4e-42b7-89b6-072e5835e75b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.728780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd755d8-2f4e-42b7-89b6-072e5835e75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.756901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-afd755d8-2f4e-42b7-89b6-072e5835e75b None None] MFA Rules not processed for user `8dd5d5cb0b45472f82e55f9c567c3bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:01.758097 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-afd755d8-2f4e-42b7-89b6-072e5835e75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:01.818696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1176/2352] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:01.823069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f391480-5945-4a54-a3dd-83fd8ffcdbf5 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:01.881923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f391480-5945-4a54-a3dd-83fd8ffcdbf5 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:01.886465 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386f3ed-8448-4781-82cc-df2b4e96bfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:01.887110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386f3ed-8448-4781-82cc-df2b4e96bfed admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.887397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386f3ed-8448-4781-82cc-df2b4e96bfed admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.887668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386f3ed-8448-4781-82cc-df2b4e96bfed admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.888376 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386f3ed-8448-4781-82cc-df2b4e96bfed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:01.890256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386f3ed-8448-4781-82cc-df2b4e96bfed admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:01.914583 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1177/2353] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:14:01 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:14:01.918620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd755d8-2f4e-42b7-89b6-072e5835e75b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:01.929781 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd755d8-2f4e-42b7-89b6-072e5835e75b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:01.984483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd35671-1e81-4267-923a-158a9e6978fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:01.985151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd35671-1e81-4267-923a-158a9e6978fa admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:01.985433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd35671-1e81-4267-923a-158a9e6978fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:01.985707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd35671-1e81-4267-923a-158a9e6978fa admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:01.986387 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd35671-1e81-4267-923a-158a9e6978fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:01.988908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd35671-1e81-4267-923a-158a9e6978fa admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:02.008302 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1177/2354] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:14:01 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:02.012313 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386f3ed-8448-4781-82cc-df2b4e96bfed admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:02.022386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386f3ed-8448-4781-82cc-df2b4e96bfed admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:02.027087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a97cca-702c-41a0-aba7-c28ba4b6d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:02.027765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a97cca-702c-41a0-aba7-c28ba4b6d03c admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:02.028051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a97cca-702c-41a0-aba7-c28ba4b6d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:02.028369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a97cca-702c-41a0-aba7-c28ba4b6d03c admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:02.029124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a97cca-702c-41a0-aba7-c28ba4b6d03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:02.030726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a97cca-702c-41a0-aba7-c28ba4b6d03c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:02.041465 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1178/2355] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:14:02.045357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd35671-1e81-4267-923a-158a9e6978fa admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:02.055257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd35671-1e81-4267-923a-158a9e6978fa admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:02.059848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77817f-3e86-44dd-9b63-33f02fed0237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:02.060754 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77817f-3e86-44dd-9b63-33f02fed0237 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:02.061036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77817f-3e86-44dd-9b63-33f02fed0237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:02.061314 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77817f-3e86-44dd-9b63-33f02fed0237 admin admin] PATH_INFO: `/v3/projects/5159d0087c0b43729cac562ba59863a7/users/31f09198573f48f0a024e4934fc27548/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:02.076425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77817f-3e86-44dd-9b63-33f02fed0237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5159d0087c0b43729cac562ba59863a7, user_id=31f09198573f48f0a024e4934fc27548, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:02.079040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77817f-3e86-44dd-9b63-33f02fed0237 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:02.091910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1178/2356] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:14:02 2022] PUT /identity/v3/projects/5159d0087c0b43729cac562ba59863a7/users/31f09198573f48f0a024e4934fc27548/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:02.096355 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a97cca-702c-41a0-aba7-c28ba4b6d03c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:02.106238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a97cca-702c-41a0-aba7-c28ba4b6d03c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:02.160000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec9f41-4add-4235-bac9-04d34c63b317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:02.160824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec9f41-4add-4235-bac9-04d34c63b317 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:02.161118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec9f41-4add-4235-bac9-04d34c63b317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:02.161400 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec9f41-4add-4235-bac9-04d34c63b317 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:02.162128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec9f41-4add-4235-bac9-04d34c63b317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:02.164227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec9f41-4add-4235-bac9-04d34c63b317 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:02.173901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1179/2357] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:14:02.179039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77817f-3e86-44dd-9b63-33f02fed0237 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:02.189093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77817f-3e86-44dd-9b63-33f02fed0237 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:02.193823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9bc6c-8b96-43a9-b5cf-7cec60b5b438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:02.194691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9bc6c-8b96-43a9-b5cf-7cec60b5b438 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:02.194970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9bc6c-8b96-43a9-b5cf-7cec60b5b438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:02.195246 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9bc6c-8b96-43a9-b5cf-7cec60b5b438 admin admin] PATH_INFO: `/v3/projects/5159d0087c0b43729cac562ba59863a7/users/31f09198573f48f0a024e4934fc27548/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:02.197312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9bc6c-8b96-43a9-b5cf-7cec60b5b438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5159d0087c0b43729cac562ba59863a7, user_id=31f09198573f48f0a024e4934fc27548, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:02.200251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9bc6c-8b96-43a9-b5cf-7cec60b5b438 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:02.211409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1179/2358] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:14:02 2022] PUT /identity/v3/projects/5159d0087c0b43729cac562ba59863a7/users/31f09198573f48f0a024e4934fc27548/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:02.223672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6301a0-1d2b-4c44-8d2b-3b041603dd3b None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:02.224210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6301a0-1d2b-4c44-8d2b-3b041603dd3b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:02.224319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6301a0-1d2b-4c44-8d2b-3b041603dd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:02.250663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ef6301a0-1d2b-4c44-8d2b-3b041603dd3b None None] MFA Rules not processed for user `31f09198573f48f0a024e4934fc27548`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:02.251858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ef6301a0-1d2b-4c44-8d2b-3b041603dd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:02.317005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1180/2359] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:02.329399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9bc6c-8b96-43a9-b5cf-7cec60b5b438 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:02.331095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-58d9bc6c-8b96-43a9-b5cf-7cec60b5b438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:02.387348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9bc6c-8b96-43a9-b5cf-7cec60b5b438 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:02.390885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e038203-33fc-4999-8a5a-d71eac9262a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:02.391513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038203-33fc-4999-8a5a-d71eac9262a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:02.391791 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038203-33fc-4999-8a5a-d71eac9262a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:02.392064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038203-33fc-4999-8a5a-d71eac9262a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:02.401522 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e038203-33fc-4999-8a5a-d71eac9262a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:02.402929 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e038203-33fc-4999-8a5a-d71eac9262a0 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:02.412878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1180/2360] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:14:02.702378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6301a0-1d2b-4c44-8d2b-3b041603dd3b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:02.711893 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6301a0-1d2b-4c44-8d2b-3b041603dd3b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:02.717931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0c7fe-5a2e-4a85-9cf1-bcb1df80b329 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f09198573f48f0a024e4934fc27548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5159d0087c0b43729cac562ba59863a7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:02.718753 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0c7fe-5a2e-4a85-9cf1-bcb1df80b329 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:02.719055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0c7fe-5a2e-4a85-9cf1-bcb1df80b329 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:02.719323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0c7fe-5a2e-4a85-9cf1-bcb1df80b329 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:02.720062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0c7fe-5a2e-4a85-9cf1-bcb1df80b329 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:14:02.720405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0c7fe-5a2e-4a85-9cf1-bcb1df80b329 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:02.722159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0c7fe-5a2e-4a85-9cf1-bcb1df80b329 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:02.733731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1181/2361] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:14:02.738008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e038203-33fc-4999-8a5a-d71eac9262a0 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:02.747016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e038203-33fc-4999-8a5a-d71eac9262a0 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:02.751647 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0a21d-1579-416b-b691-7aa0f58a1c6d tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f09198573f48f0a024e4934fc27548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5159d0087c0b43729cac562ba59863a7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:02.752324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0a21d-1579-416b-b691-7aa0f58a1c6d tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:02.752635 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0a21d-1579-416b-b691-7aa0f58a1c6d tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:02.752918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0a21d-1579-416b-b691-7aa0f58a1c6d tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:02.754109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0a21d-1579-416b-b691-7aa0f58a1c6d tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:02.756565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0a21d-1579-416b-b691-7aa0f58a1c6d tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:02.781947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1181/2362] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:14:02 2022] POST /identity/v3/projects => generated 351 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:02.786027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0c7fe-5a2e-4a85-9cf1-bcb1df80b329 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:02.795608 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0c7fe-5a2e-4a85-9cf1-bcb1df80b329 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:02.850152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c6bab-faf1-4d3a-ae5f-f99988724338 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f09198573f48f0a024e4934fc27548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5159d0087c0b43729cac562ba59863a7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:02.850725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c6bab-faf1-4d3a-ae5f-f99988724338 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:02.851009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c6bab-faf1-4d3a-ae5f-f99988724338 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:02.851285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c6bab-faf1-4d3a-ae5f-f99988724338 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:02.852000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c6bab-faf1-4d3a-ae5f-f99988724338 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:14:02.852342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c6bab-faf1-4d3a-ae5f-f99988724338 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:02.853967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c6bab-faf1-4d3a-ae5f-f99988724338 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:02.864938 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1182/2363] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:14:02.900757 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0a21d-1579-416b-b691-7aa0f58a1c6d tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:02.910981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0a21d-1579-416b-b691-7aa0f58a1c6d tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:02.915559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f09198573f48f0a024e4934fc27548', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5159d0087c0b43729cac562ba59863a7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:02.916432 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:02.916721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:02.917002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] PATH_INFO: `/v3/projects/27085c09d59c4378807d9fd384df875a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:02.918186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: Authorizing `identity:delete_project(project_id=27085c09d59c4378807d9fd384df875a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:02.920072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:02.965601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27085c09d59c4378807d9fd384df875a', 'request_id': 'req-53af5bc9-245e-48e1-9056-6b114cf6a49f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:02.972855 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27085c09d59c4378807d9fd384df875a', 'request_id': 'req-53af5bc9-245e-48e1-9056-6b114cf6a49f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:02.978889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27085c09d59c4378807d9fd384df875a', 'request_id': 'req-53af5bc9-245e-48e1-9056-6b114cf6a49f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:02.988696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] The token cache is being invalidate because project 27085c09d59c4378807d9fd384df875a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:14:02.988995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:02.989665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-53af5bc9-245e-48e1-9056-6b114cf6a49f tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:02.991235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1182/2364] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:14:02 2022] DELETE /identity/v3/projects/27085c09d59c4378807d9fd384df875a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:03.168601 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c6bab-faf1-4d3a-ae5f-f99988724338 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:03.170321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-104c6bab-faf1-4d3a-ae5f-f99988724338 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:03.232741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c6bab-faf1-4d3a-ae5f-f99988724338 tempest-VolumeQuotaClassesTest-1699080999 tempest-VolumeQuotaClassesTest-1699080999-project-admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:03.286344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:03.287197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:03.287480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:03.287756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] PATH_INFO: `/v3/users/8dd5d5cb0b45472f82e55f9c567c3bc3` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:03.288958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd5d5cb0b45472f82e55f9c567c3bc3)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:03.290858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:03.334274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd5d5cb0b45472f82e55f9c567c3bc3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:03.334917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd5d5cb0b45472f82e55f9c567c3bc3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:03.341392 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd5d5cb0b45472f82e55f9c567c3bc3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:03.349909 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd5d5cb0b45472f82e55f9c567c3bc3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:03.350525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd5d5cb0b45472f82e55f9c567c3bc3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:03.367426 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1183/2365] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:14:03 2022] DELETE /identity/v3/users/8dd5d5cb0b45472f82e55f9c567c3bc3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:03.371868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d219e-ce1c-4114-857a-72aade4012ca None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:03.372355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d219e-ce1c-4114-857a-72aade4012ca None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:03.372461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d219e-ce1c-4114-857a-72aade4012ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:03.389528 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4d2d219e-ce1c-4114-857a-72aade4012ca None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:03.390696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4d2d219e-ce1c-4114-857a-72aade4012ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:03.447731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1183/2366] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:03.458220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:03.459650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:03.515267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9af5c3-6e90-4265-88d1-2e57ebd83794 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:03.519509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f1a59-7522-4f4b-8a05-15cff19f2842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:03.520174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f1a59-7522-4f4b-8a05-15cff19f2842 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:03.520484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f1a59-7522-4f4b-8a05-15cff19f2842 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:03.520758 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f1a59-7522-4f4b-8a05-15cff19f2842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:03.530005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f1a59-7522-4f4b-8a05-15cff19f2842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:03.531459 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f1a59-7522-4f4b-8a05-15cff19f2842 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:03.541196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1184/2367] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:14:03.796923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d219e-ce1c-4114-857a-72aade4012ca None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:03.798339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4d2d219e-ce1c-4114-857a-72aade4012ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:03.811927 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d219e-ce1c-4114-857a-72aade4012ca None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:03.818132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:03.818852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:03.819188 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:03.819406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] PATH_INFO: `/v3/projects/dba7d0b4f9ff48bb9da2fd03d3575afd` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:03.820639 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba7d0b4f9ff48bb9da2fd03d3575afd)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:03.822680 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:03.869664 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba7d0b4f9ff48bb9da2fd03d3575afd', 'request_id': 'req-d766b307-86f7-40d1-9c36-939596800fdc'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:03.876727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba7d0b4f9ff48bb9da2fd03d3575afd', 'request_id': 'req-d766b307-86f7-40d1-9c36-939596800fdc'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:03.883494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba7d0b4f9ff48bb9da2fd03d3575afd', 'request_id': 'req-d766b307-86f7-40d1-9c36-939596800fdc'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:03.893141 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] The token cache is being invalidate because project dba7d0b4f9ff48bb9da2fd03d3575afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:14:03.893423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:03.894237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:03.895758 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1184/2368] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:14:03 2022] DELETE /identity/v3/projects/dba7d0b4f9ff48bb9da2fd03d3575afd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:03.899868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f1a59-7522-4f4b-8a05-15cff19f2842 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:03.909386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f1a59-7522-4f4b-8a05-15cff19f2842 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:03.964880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adf23f-ea78-48f5-9422-5473a7e0dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:03.965736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adf23f-ea78-48f5-9422-5473a7e0dff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:03.966024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adf23f-ea78-48f5-9422-5473a7e0dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:03.966302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adf23f-ea78-48f5-9422-5473a7e0dff4 admin admin] PATH_INFO: `/v3/users/31f09198573f48f0a024e4934fc27548` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:03.967514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adf23f-ea78-48f5-9422-5473a7e0dff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f09198573f48f0a024e4934fc27548)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:03.969770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adf23f-ea78-48f5-9422-5473a7e0dff4 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:04.014513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-23adf23f-ea78-48f5-9422-5473a7e0dff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f09198573f48f0a024e4934fc27548'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:04.015165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-23adf23f-ea78-48f5-9422-5473a7e0dff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f09198573f48f0a024e4934fc27548'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:04.021751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-23adf23f-ea78-48f5-9422-5473a7e0dff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f09198573f48f0a024e4934fc27548'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:04.028480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-23adf23f-ea78-48f5-9422-5473a7e0dff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f09198573f48f0a024e4934fc27548'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:04.029126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-23adf23f-ea78-48f5-9422-5473a7e0dff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f09198573f48f0a024e4934fc27548'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:04.045611 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1185/2369] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:14:03 2022] DELETE /identity/v3/users/31f09198573f48f0a024e4934fc27548 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:04.316457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:04.317886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:04.332656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766b307-86f7-40d1-9c36-939596800fdc admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:04.391279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:04.392127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:04.392437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:04.392710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] PATH_INFO: `/v3/projects/5159d0087c0b43729cac562ba59863a7` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:04.394062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5159d0087c0b43729cac562ba59863a7)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:04.396006 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:04.439807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5159d0087c0b43729cac562ba59863a7', 'request_id': 'req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:04.446543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5159d0087c0b43729cac562ba59863a7', 'request_id': 'req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:04.453184 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5159d0087c0b43729cac562ba59863a7', 'request_id': 'req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:04.463194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] The token cache is being invalidate because project 5159d0087c0b43729cac562ba59863a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:14:04.463481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:04.464104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6fd4a8f4-1477-4de7-b192-4e5c3e1f4084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:04.465661 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1185/2370] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:14:04 2022] DELETE /identity/v3/projects/5159d0087c0b43729cac562ba59863a7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:04.470663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13f617-26ec-4283-81f8-e884c9e04e3d None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:04.471160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13f617-26ec-4283-81f8-e884c9e04e3d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:04.471264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13f617-26ec-4283-81f8-e884c9e04e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:04.490344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-fe13f617-26ec-4283-81f8-e884c9e04e3d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:04.491450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-fe13f617-26ec-4283-81f8-e884c9e04e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:04.548717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1186/2371] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:04.557288 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78e5dd-1968-4689-9688-9c0d946ab07c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:04.557580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78e5dd-1968-4689-9688-9c0d946ab07c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:04.557859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78e5dd-1968-4689-9688-9c0d946ab07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:04.577403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-2b78e5dd-1968-4689-9688-9c0d946ab07c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:04.578590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2b78e5dd-1968-4689-9688-9c0d946ab07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:04.587421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1186/2372] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:04.591718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13f617-26ec-4283-81f8-e884c9e04e3d None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:04.602192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13f617-26ec-4283-81f8-e884c9e04e3d None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:04.606654 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf10d5-cc57-4750-9916-d36f63160ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:04.607298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf10d5-cc57-4750-9916-d36f63160ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:04.607578 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf10d5-cc57-4750-9916-d36f63160ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:04.607847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf10d5-cc57-4750-9916-d36f63160ec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:04.608606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf10d5-cc57-4750-9916-d36f63160ec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:14:04.608913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf10d5-cc57-4750-9916-d36f63160ec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:04.610494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf10d5-cc57-4750-9916-d36f63160ec2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:04.622021 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1187/2373] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:14:04.626308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78e5dd-1968-4689-9688-9c0d946ab07c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:04.635345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78e5dd-1968-4689-9688-9c0d946ab07c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:04.639954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f778e1a-8d59-4807-86c5-04192875e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:04.640624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778e1a-8d59-4807-86c5-04192875e0fe admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:04.640910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778e1a-8d59-4807-86c5-04192875e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:04.641186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f778e1a-8d59-4807-86c5-04192875e0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:04.641883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f778e1a-8d59-4807-86c5-04192875e0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:04.644472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f778e1a-8d59-4807-86c5-04192875e0fe admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:04.668925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1187/2374] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:14:04 2022] POST /identity/v3/projects => generated 409 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:04.673221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf10d5-cc57-4750-9916-d36f63160ec2 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:04.684226 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf10d5-cc57-4750-9916-d36f63160ec2 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:04.738553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdedd4-0361-49ba-84ac-60507104ff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:04.739214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdedd4-0361-49ba-84ac-60507104ff84 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:04.739497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdedd4-0361-49ba-84ac-60507104ff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:04.739770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdedd4-0361-49ba-84ac-60507104ff84 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:04.740490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdedd4-0361-49ba-84ac-60507104ff84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:04.742408 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdedd4-0361-49ba-84ac-60507104ff84 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:04.761890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1188/2375] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:14:04 2022] POST /identity/v3/users => generated 305 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:04.766119 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f778e1a-8d59-4807-86c5-04192875e0fe admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:04.776402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f778e1a-8d59-4807-86c5-04192875e0fe admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:04.781024 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb3d2e-22a9-4c23-a5d0-0115796febb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:04.781669 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb3d2e-22a9-4c23-a5d0-0115796febb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:04.781950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb3d2e-22a9-4c23-a5d0-0115796febb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:04.782224 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb3d2e-22a9-4c23-a5d0-0115796febb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:04.783000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb3d2e-22a9-4c23-a5d0-0115796febb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:04.784830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb3d2e-22a9-4c23-a5d0-0115796febb2 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:04.794853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1188/2376] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:14:04.798535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdedd4-0361-49ba-84ac-60507104ff84 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:04.809307 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdedd4-0361-49ba-84ac-60507104ff84 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:04.814009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c0d21-ed4c-4b20-afa1-3ae1c390d237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:04.814685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c0d21-ed4c-4b20-afa1-3ae1c390d237 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:04.814968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c0d21-ed4c-4b20-afa1-3ae1c390d237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:04.815242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c0d21-ed4c-4b20-afa1-3ae1c390d237 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:04.816679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c0d21-ed4c-4b20-afa1-3ae1c390d237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:04.818346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c0d21-ed4c-4b20-afa1-3ae1c390d237 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:04.829618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1189/2377] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:14:04.833908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb3d2e-22a9-4c23-a5d0-0115796febb2 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:04.843662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb3d2e-22a9-4c23-a5d0-0115796febb2 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:04.848542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9ae72-6d88-4c00-9778-2ee790b14737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:04.849336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9ae72-6d88-4c00-9778-2ee790b14737 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:04.849615 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9ae72-6d88-4c00-9778-2ee790b14737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:04.849888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9ae72-6d88-4c00-9778-2ee790b14737 admin admin] PATH_INFO: `/v3/projects/8701aa52881d4c04a94d700f0f7d305f/users/7842e5a8a8414fee93475d86fb92a00a/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:04.864840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9ae72-6d88-4c00-9778-2ee790b14737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8701aa52881d4c04a94d700f0f7d305f, user_id=7842e5a8a8414fee93475d86fb92a00a, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:04.867480 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9ae72-6d88-4c00-9778-2ee790b14737 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:04.880955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1189/2378] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:14:04 2022] PUT /identity/v3/projects/8701aa52881d4c04a94d700f0f7d305f/users/7842e5a8a8414fee93475d86fb92a00a/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:04.891193 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a841df-fcf7-45f1-ac4a-9cdd74fa12f9 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:04.891478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a841df-fcf7-45f1-ac4a-9cdd74fa12f9 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:04.891750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a841df-fcf7-45f1-ac4a-9cdd74fa12f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:04.916891 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-05a841df-fcf7-45f1-ac4a-9cdd74fa12f9 None None] MFA Rules not processed for user `7842e5a8a8414fee93475d86fb92a00a`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:04.918058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-05a841df-fcf7-45f1-ac4a-9cdd74fa12f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:04.980390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1190/2379] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:04.984800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9ae72-6d88-4c00-9778-2ee790b14737 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:05.043575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9ae72-6d88-4c00-9778-2ee790b14737 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:05.048137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8ae2-5c5c-4edd-aa60-eb219069c05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:05.048801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8ae2-5c5c-4edd-aa60-eb219069c05b admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:05.049084 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8ae2-5c5c-4edd-aa60-eb219069c05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:05.049362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8ae2-5c5c-4edd-aa60-eb219069c05b admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:05.050577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff8ae2-5c5c-4edd-aa60-eb219069c05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:05.052508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff8ae2-5c5c-4edd-aa60-eb219069c05b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:05.076488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1190/2380] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:14:04 2022] POST /identity/v3/projects => generated 409 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:05.080527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a841df-fcf7-45f1-ac4a-9cdd74fa12f9 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:05.090766 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a841df-fcf7-45f1-ac4a-9cdd74fa12f9 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:05.145082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb791d78-1813-4045-912e-683626bb8fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:05.145749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791d78-1813-4045-912e-683626bb8fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:05.146028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791d78-1813-4045-912e-683626bb8fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:05.146301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791d78-1813-4045-912e-683626bb8fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:05.146986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791d78-1813-4045-912e-683626bb8fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:05.149202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791d78-1813-4045-912e-683626bb8fb4 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:05.168819 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1191/2381] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:14:05 2022] POST /identity/v3/users => generated 311 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:05.172815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8ae2-5c5c-4edd-aa60-eb219069c05b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:05.183410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8ae2-5c5c-4edd-aa60-eb219069c05b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:05.187921 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a2fe-c5c6-4030-8498-df39727ca5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:05.188675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a2fe-c5c6-4030-8498-df39727ca5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:05.188955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a2fe-c5c6-4030-8498-df39727ca5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:05.189229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a2fe-c5c6-4030-8498-df39727ca5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:05.189946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a2fe-c5c6-4030-8498-df39727ca5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:05.191556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a2fe-c5c6-4030-8498-df39727ca5ca admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:05.201898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1191/2382] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:14:05.205833 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb791d78-1813-4045-912e-683626bb8fb4 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:05.215836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb791d78-1813-4045-912e-683626bb8fb4 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:05.220730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bd394-4680-464e-83ee-356832d57983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:05.221594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bd394-4680-464e-83ee-356832d57983 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:05.222367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bd394-4680-464e-83ee-356832d57983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:05.222655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bd394-4680-464e-83ee-356832d57983 admin admin] PATH_INFO: `/v3/projects/166e888af0814e4ea785f9ecd491ce39/users/a12e391d76a0438eba62bb8ba6ed0db8/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:05.238517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bd394-4680-464e-83ee-356832d57983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166e888af0814e4ea785f9ecd491ce39, user_id=a12e391d76a0438eba62bb8ba6ed0db8, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:05.241104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bd394-4680-464e-83ee-356832d57983 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:05.253571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1192/2383] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:14:05 2022] PUT /identity/v3/projects/166e888af0814e4ea785f9ecd491ce39/users/a12e391d76a0438eba62bb8ba6ed0db8/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:05.257476 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a2fe-c5c6-4030-8498-df39727ca5ca admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:05.267076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a2fe-c5c6-4030-8498-df39727ca5ca admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:05.320070 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceeebe3-97fc-4011-a192-29abc9aaef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:05.320744 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeebe3-97fc-4011-a192-29abc9aaef73 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:05.321023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeebe3-97fc-4011-a192-29abc9aaef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:05.321295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeebe3-97fc-4011-a192-29abc9aaef73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:05.322008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceeebe3-97fc-4011-a192-29abc9aaef73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:05.323832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceeebe3-97fc-4011-a192-29abc9aaef73 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:05.333799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1192/2384] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:14:05.337866 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bd394-4680-464e-83ee-356832d57983 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:05.348518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bd394-4680-464e-83ee-356832d57983 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:05.353087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c917885-5bc9-40e7-98b9-0be8d6a3ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:05.353953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917885-5bc9-40e7-98b9-0be8d6a3ca76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:05.354256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917885-5bc9-40e7-98b9-0be8d6a3ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:05.354534 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917885-5bc9-40e7-98b9-0be8d6a3ca76 admin admin] PATH_INFO: `/v3/projects/166e888af0814e4ea785f9ecd491ce39/users/a12e391d76a0438eba62bb8ba6ed0db8/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:05.356536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c917885-5bc9-40e7-98b9-0be8d6a3ca76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166e888af0814e4ea785f9ecd491ce39, user_id=a12e391d76a0438eba62bb8ba6ed0db8, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:05.359192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c917885-5bc9-40e7-98b9-0be8d6a3ca76 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:05.369045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1193/2385] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:14:05 2022] PUT /identity/v3/projects/166e888af0814e4ea785f9ecd491ce39/users/a12e391d76a0438eba62bb8ba6ed0db8/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:05.380831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f770958-d6db-455c-8ced-20873afcf0ff None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:05.381344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f770958-d6db-455c-8ced-20873afcf0ff None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:05.381843 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f770958-d6db-455c-8ced-20873afcf0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:05.409230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-5f770958-d6db-455c-8ced-20873afcf0ff None None] MFA Rules not processed for user `a12e391d76a0438eba62bb8ba6ed0db8`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:05.411178 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5f770958-d6db-455c-8ced-20873afcf0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:05.477824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1193/2386] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:05 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:05.489458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c917885-5bc9-40e7-98b9-0be8d6a3ca76 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:05.491462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6c917885-5bc9-40e7-98b9-0be8d6a3ca76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:05.552059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c917885-5bc9-40e7-98b9-0be8d6a3ca76 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:05.555992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c455401-3c04-4dd9-89b0-5a7462c14e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:05.557107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c455401-3c04-4dd9-89b0-5a7462c14e1a service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:05.557626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c455401-3c04-4dd9-89b0-5a7462c14e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:05.558126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c455401-3c04-4dd9-89b0-5a7462c14e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:05.571924 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c455401-3c04-4dd9-89b0-5a7462c14e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:05.574307 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c455401-3c04-4dd9-89b0-5a7462c14e1a service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:05.584913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1194/2387] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:05 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:14:05.730962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f770958-d6db-455c-8ced-20873afcf0ff None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:05.740606 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f770958-d6db-455c-8ced-20873afcf0ff None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:05.744056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f29d6c-79f2-4e21-94be-641617412bca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:05.744728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29d6c-79f2-4e21-94be-641617412bca service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:05.745008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29d6c-79f2-4e21-94be-641617412bca service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:05.745283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f29d6c-79f2-4e21-94be-641617412bca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:05.800640 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f29d6c-79f2-4e21-94be-641617412bca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:05.802058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f29d6c-79f2-4e21-94be-641617412bca service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:05.810736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1194/2388] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:14:15.124041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c455401-3c04-4dd9-89b0-5a7462c14e1a service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:15.187859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c455401-3c04-4dd9-89b0-5a7462c14e1a service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:15.193568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:15.194994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:15.195380 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:15.195759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] PATH_INFO: `/v3/users/7842e5a8a8414fee93475d86fb92a00a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:15.197573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7842e5a8a8414fee93475d86fb92a00a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:15.200926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:15.259480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7842e5a8a8414fee93475d86fb92a00a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:15.260369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7842e5a8a8414fee93475d86fb92a00a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:15.268507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7842e5a8a8414fee93475d86fb92a00a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:15.286120 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7842e5a8a8414fee93475d86fb92a00a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:15.286900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7842e5a8a8414fee93475d86fb92a00a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:15.305841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1195/2389] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:14:15 2022] DELETE /identity/v3/users/7842e5a8a8414fee93475d86fb92a00a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:14:15.310888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae427881-af3b-4930-832f-d301e6cd56d8 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:15.311380 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae427881-af3b-4930-832f-d301e6cd56d8 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:15.311596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae427881-af3b-4930-832f-d301e6cd56d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:15.328920 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ae427881-af3b-4930-832f-d301e6cd56d8 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:15.330149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ae427881-af3b-4930-832f-d301e6cd56d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:15.389809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1195/2390] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:15.400162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:15.401757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:15.458079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45eb25-64f2-41a0-b7fc-4c843c7db7b2 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:15.462373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cff68d-0443-4d12-8967-688ec417b12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:15.463020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff68d-0443-4d12-8967-688ec417b12e service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:15.463301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff68d-0443-4d12-8967-688ec417b12e service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:15.463570 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff68d-0443-4d12-8967-688ec417b12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:15.473159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cff68d-0443-4d12-8967-688ec417b12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:15.474569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cff68d-0443-4d12-8967-688ec417b12e service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:15.484075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1196/2391] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:14:15.761889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae427881-af3b-4930-832f-d301e6cd56d8 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:15.763311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ae427881-af3b-4930-832f-d301e6cd56d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:15.778809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae427881-af3b-4930-832f-d301e6cd56d8 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:15.784489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:15.786198 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:15.786641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:15.786954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] PATH_INFO: `/v3/projects/8701aa52881d4c04a94d700f0f7d305f` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:15.790176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8701aa52881d4c04a94d700f0f7d305f)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:15.792262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:15.839427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8701aa52881d4c04a94d700f0f7d305f', 'request_id': 'req-c2ea645c-bf71-42e1-88ec-a0f141c6239a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:15.846761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8701aa52881d4c04a94d700f0f7d305f', 'request_id': 'req-c2ea645c-bf71-42e1-88ec-a0f141c6239a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:15.854685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8701aa52881d4c04a94d700f0f7d305f', 'request_id': 'req-c2ea645c-bf71-42e1-88ec-a0f141c6239a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:15.866163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] The token cache is being invalidate because project 8701aa52881d4c04a94d700f0f7d305f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:14:15.866731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:15.867452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:15.869130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1196/2392] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:14:15 2022] DELETE /identity/v3/projects/8701aa52881d4c04a94d700f0f7d305f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:15.873348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cff68d-0443-4d12-8967-688ec417b12e service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:15.882716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cff68d-0443-4d12-8967-688ec417b12e service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:15.941048 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34886b1-61da-4d80-96e2-55195dff39c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:15.942307 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34886b1-61da-4d80-96e2-55195dff39c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:15.942802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34886b1-61da-4d80-96e2-55195dff39c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:15.943062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34886b1-61da-4d80-96e2-55195dff39c7 admin admin] PATH_INFO: `/v3/users/a12e391d76a0438eba62bb8ba6ed0db8` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:15.944404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34886b1-61da-4d80-96e2-55195dff39c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12e391d76a0438eba62bb8ba6ed0db8)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:15.946352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34886b1-61da-4d80-96e2-55195dff39c7 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:15.995332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-c34886b1-61da-4d80-96e2-55195dff39c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12e391d76a0438eba62bb8ba6ed0db8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:15.996074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-c34886b1-61da-4d80-96e2-55195dff39c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12e391d76a0438eba62bb8ba6ed0db8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:16.003096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-c34886b1-61da-4d80-96e2-55195dff39c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12e391d76a0438eba62bb8ba6ed0db8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:16.010868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-c34886b1-61da-4d80-96e2-55195dff39c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12e391d76a0438eba62bb8ba6ed0db8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:16.011566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-c34886b1-61da-4d80-96e2-55195dff39c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12e391d76a0438eba62bb8ba6ed0db8'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:16.030475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1197/2393] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:14:15 2022] DELETE /identity/v3/users/a12e391d76a0438eba62bb8ba6ed0db8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:16.335534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:16.338194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:16.353134 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea645c-bf71-42e1-88ec-a0f141c6239a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:16.421141 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:16.422085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:16.422438 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:16.422778 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] PATH_INFO: `/v3/projects/166e888af0814e4ea785f9ecd491ce39` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:16.424027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] RBAC: Authorizing `identity:delete_project(project_id=166e888af0814e4ea785f9ecd491ce39)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:16.426314 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:16.474956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166e888af0814e4ea785f9ecd491ce39', 'request_id': 'req-56a34e1f-3c91-421c-b54e-ad33222413da'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:16.482255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166e888af0814e4ea785f9ecd491ce39', 'request_id': 'req-56a34e1f-3c91-421c-b54e-ad33222413da'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:16.488897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166e888af0814e4ea785f9ecd491ce39', 'request_id': 'req-56a34e1f-3c91-421c-b54e-ad33222413da'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:16.498779 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] The token cache is being invalidate because project 166e888af0814e4ea785f9ecd491ce39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:14:16.499064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:16.499709 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-56a34e1f-3c91-421c-b54e-ad33222413da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:16.501285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1197/2394] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:14:16 2022] DELETE /identity/v3/projects/166e888af0814e4ea785f9ecd491ce39 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:16.508466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa429934-d69f-4c9a-80cc-db4ea7144b99 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:16.508992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa429934-d69f-4c9a-80cc-db4ea7144b99 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:16.509090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa429934-d69f-4c9a-80cc-db4ea7144b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:16.528137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-fa429934-d69f-4c9a-80cc-db4ea7144b99 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:16.529266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-fa429934-d69f-4c9a-80cc-db4ea7144b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:16.592514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1198/2395] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:16.600546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87013b2-4212-4c58-afaf-12dcf49ba081 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:16.600836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87013b2-4212-4c58-afaf-12dcf49ba081 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:16.601109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87013b2-4212-4c58-afaf-12dcf49ba081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:16.620710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a87013b2-4212-4c58-afaf-12dcf49ba081 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:16.621913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a87013b2-4212-4c58-afaf-12dcf49ba081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:16.630889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1198/2396] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:16.635068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa429934-d69f-4c9a-80cc-db4ea7144b99 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:16.644925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa429934-d69f-4c9a-80cc-db4ea7144b99 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:16.649755 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63164a2-d6b5-436b-8a97-6bd061a284d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:16.650414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63164a2-d6b5-436b-8a97-6bd061a284d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:16.650696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63164a2-d6b5-436b-8a97-6bd061a284d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:16.650968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63164a2-d6b5-436b-8a97-6bd061a284d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:16.651695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63164a2-d6b5-436b-8a97-6bd061a284d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:14:16.652000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63164a2-d6b5-436b-8a97-6bd061a284d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:16.653679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63164a2-d6b5-436b-8a97-6bd061a284d5 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:16.666185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1199/2397] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:14:16.670691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87013b2-4212-4c58-afaf-12dcf49ba081 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:16.681483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87013b2-4212-4c58-afaf-12dcf49ba081 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:16.687540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed299c-1114-4b0f-8ebc-092f893d1d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:16.688229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed299c-1114-4b0f-8ebc-092f893d1d17 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:16.688515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed299c-1114-4b0f-8ebc-092f893d1d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:16.688790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed299c-1114-4b0f-8ebc-092f893d1d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:16.689492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed299c-1114-4b0f-8ebc-092f893d1d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:16.691514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed299c-1114-4b0f-8ebc-092f893d1d17 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:16.720579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1199/2398] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:14:16 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:16.724952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63164a2-d6b5-436b-8a97-6bd061a284d5 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:16.735950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63164a2-d6b5-436b-8a97-6bd061a284d5 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:16.792309 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cc10-6db5-4a73-95c5-d74630c1aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:16.792995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cc10-6db5-4a73-95c5-d74630c1aa3c admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:16.793281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cc10-6db5-4a73-95c5-d74630c1aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:16.793558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cc10-6db5-4a73-95c5-d74630c1aa3c admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:16.794255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cc10-6db5-4a73-95c5-d74630c1aa3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:16.796201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cc10-6db5-4a73-95c5-d74630c1aa3c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:16.819273 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1200/2399] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:14:16 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:16.820976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed299c-1114-4b0f-8ebc-092f893d1d17 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:16.832112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed299c-1114-4b0f-8ebc-092f893d1d17 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:16.836783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c64f8-4c32-4ca9-9aed-ee461f91a659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:16.837439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c64f8-4c32-4ca9-9aed-ee461f91a659 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:16.837832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c64f8-4c32-4ca9-9aed-ee461f91a659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:16.838111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c64f8-4c32-4ca9-9aed-ee461f91a659 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:16.838833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c64f8-4c32-4ca9-9aed-ee461f91a659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:16.840450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c64f8-4c32-4ca9-9aed-ee461f91a659 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:16.850794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1200/2400] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:14:16.854828 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cc10-6db5-4a73-95c5-d74630c1aa3c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:16.865367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cc10-6db5-4a73-95c5-d74630c1aa3c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:16.870181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b928f-1440-4cd1-bb1e-5c6b005779fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:16.870915 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b928f-1440-4cd1-bb1e-5c6b005779fb admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:16.871270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b928f-1440-4cd1-bb1e-5c6b005779fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:16.871676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b928f-1440-4cd1-bb1e-5c6b005779fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:16.872499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b928f-1440-4cd1-bb1e-5c6b005779fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:16.874218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b928f-1440-4cd1-bb1e-5c6b005779fb admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:16.889634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1201/2401] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:14:16.891092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c64f8-4c32-4ca9-9aed-ee461f91a659 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:16.901580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c64f8-4c32-4ca9-9aed-ee461f91a659 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:16.906309 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b0c6f-73be-42df-b0dc-fb83d70e1f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:16.907116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0c6f-73be-42df-b0dc-fb83d70e1f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:16.907396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0c6f-73be-42df-b0dc-fb83d70e1f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:16.907684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0c6f-73be-42df-b0dc-fb83d70e1f92 admin admin] PATH_INFO: `/v3/projects/be362587f46c44f0931f22bf6f030c68/users/18c51b4e3b094b66a6e01d4d1a3ded46/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:16.922061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b0c6f-73be-42df-b0dc-fb83d70e1f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be362587f46c44f0931f22bf6f030c68, user_id=18c51b4e3b094b66a6e01d4d1a3ded46, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:16.924702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b0c6f-73be-42df-b0dc-fb83d70e1f92 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:16.938958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1201/2402] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:14:16 2022] PUT /identity/v3/projects/be362587f46c44f0931f22bf6f030c68/users/18c51b4e3b094b66a6e01d4d1a3ded46/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:16.951890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65b47d-02e6-481a-b3bf-c3e09cdc4b20 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:16.952776 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65b47d-02e6-481a-b3bf-c3e09cdc4b20 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:16.952776 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65b47d-02e6-481a-b3bf-c3e09cdc4b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:16.979839 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-0f65b47d-02e6-481a-b3bf-c3e09cdc4b20 None None] MFA Rules not processed for user `18c51b4e3b094b66a6e01d4d1a3ded46`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:16.981083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0f65b47d-02e6-481a-b3bf-c3e09cdc4b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:17.049378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1202/2403] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:17.053444 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17aa21-57b4-4a7a-8378-b4ab78122951 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:17.054082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17aa21-57b4-4a7a-8378-b4ab78122951 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:17.054396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17aa21-57b4-4a7a-8378-b4ab78122951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:17.060926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65b47d-02e6-481a-b3bf-c3e09cdc4b20 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:17.062283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0f65b47d-02e6-481a-b3bf-c3e09cdc4b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:17.072768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-2a17aa21-57b4-4a7a-8378-b4ab78122951 None None] MFA Rules not processed for user `79ff688720854ad1b62b3c9b51546e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:17.074536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2a17aa21-57b4-4a7a-8378-b4ab78122951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:17.126609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65b47d-02e6-481a-b3bf-c3e09cdc4b20 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:17.130404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542b87-71fb-42ff-b304-f81420ecac44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:17.131130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542b87-71fb-42ff-b304-f81420ecac44 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:17.131425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542b87-71fb-42ff-b304-f81420ecac44 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:17.131705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a542b87-71fb-42ff-b304-f81420ecac44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:17.138207 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1202/2404] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:14:17.141621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a542b87-71fb-42ff-b304-f81420ecac44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:17.143079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a542b87-71fb-42ff-b304-f81420ecac44 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:17.154010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1203/2405] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:14:35.632751 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17aa21-57b4-4a7a-8378-b4ab78122951 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:35.634123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2a17aa21-57b4-4a7a-8378-b4ab78122951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:35.702896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17aa21-57b4-4a7a-8378-b4ab78122951 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:35.707832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c446f-48bd-41c4-a87c-69964cffa18a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5222a62941948229324ec8c073caf86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:35.709097 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c446f-48bd-41c4-a87c-69964cffa18a service placement] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:35.709381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c446f-48bd-41c4-a87c-69964cffa18a service placement] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:35.709658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c446f-48bd-41c4-a87c-69964cffa18a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:35.711414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f49c446f-48bd-41c4-a87c-69964cffa18a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:35.722508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c446f-48bd-41c4-a87c-69964cffa18a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:35.724110 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c446f-48bd-41c4-a87c-69964cffa18a service placement] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:35.733657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1203/2406] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:14:36.951201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542b87-71fb-42ff-b304-f81420ecac44 service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:36.952653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-8a542b87-71fb-42ff-b304-f81420ecac44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:37.007761 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a542b87-71fb-42ff-b304-f81420ecac44 service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:37.011340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f35f50-dbdb-48d9-9ccf-47295ea40514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:37.011981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35f50-dbdb-48d9-9ccf-47295ea40514 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:37.012290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35f50-dbdb-48d9-9ccf-47295ea40514 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:37.012565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35f50-dbdb-48d9-9ccf-47295ea40514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:37.014291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b1f35f50-dbdb-48d9-9ccf-47295ea40514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:37.070570 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f35f50-dbdb-48d9-9ccf-47295ea40514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:37.072001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f35f50-dbdb-48d9-9ccf-47295ea40514 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:37.080999 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1204/2407] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:14:39.519482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c446f-48bd-41c4-a87c-69964cffa18a service placement] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:39.582608 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c446f-48bd-41c4-a87c-69964cffa18a service placement] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:39.587663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:39.588565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:39.588846 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:39.589114 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] PATH_INFO: `/v3/users/18c51b4e3b094b66a6e01d4d1a3ded46` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:39.590986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c51b4e3b094b66a6e01d4d1a3ded46)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:39.592289 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:39.656797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c51b4e3b094b66a6e01d4d1a3ded46'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:39.664570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c51b4e3b094b66a6e01d4d1a3ded46'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:39.673249 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c51b4e3b094b66a6e01d4d1a3ded46'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:39.674116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c51b4e3b094b66a6e01d4d1a3ded46'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:39.674885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c51b4e3b094b66a6e01d4d1a3ded46'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:39.694148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1204/2408] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:14:39 2022] DELETE /identity/v3/users/18c51b4e3b094b66a6e01d4d1a3ded46 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:39.700737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7137df-bc63-43d4-a02d-a644c9b1cc4d None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:39.701488 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7137df-bc63-43d4-a02d-a644c9b1cc4d None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:39.701488 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7137df-bc63-43d4-a02d-a644c9b1cc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:39.728520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2a7137df-bc63-43d4-a02d-a644c9b1cc4d None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:39.730605 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2a7137df-bc63-43d4-a02d-a644c9b1cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:39.811829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1205/2409] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:39.820477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:39.822000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:39.884344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79ec61-5df3-496a-a589-5f4ba56c415d admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:39.888887 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea591f-7e09-498f-94c4-cf0a51a36f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:39.889563 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea591f-7e09-498f-94c4-cf0a51a36f80 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:39.889848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea591f-7e09-498f-94c4-cf0a51a36f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:39.890130 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea591f-7e09-498f-94c4-cf0a51a36f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:39.901396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea591f-7e09-498f-94c4-cf0a51a36f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:39.903308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea591f-7e09-498f-94c4-cf0a51a36f80 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:39.915948 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1205/2410] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:14:40.231795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7137df-bc63-43d4-a02d-a644c9b1cc4d None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:40.233427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2a7137df-bc63-43d4-a02d-a644c9b1cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:40.246164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7137df-bc63-43d4-a02d-a644c9b1cc4d None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:40.252340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:40.253219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:40.253505 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:40.254194 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] PATH_INFO: `/v3/projects/be362587f46c44f0931f22bf6f030c68` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:40.255529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be362587f46c44f0931f22bf6f030c68)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:40.257701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:40.320937 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be362587f46c44f0931f22bf6f030c68', 'request_id': 'req-341a6997-23c1-48d5-a93c-d33161303a81'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:40.328929 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be362587f46c44f0931f22bf6f030c68', 'request_id': 'req-341a6997-23c1-48d5-a93c-d33161303a81'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:40.336677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be362587f46c44f0931f22bf6f030c68', 'request_id': 'req-341a6997-23c1-48d5-a93c-d33161303a81'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:40.350151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] The token cache is being invalidate because project be362587f46c44f0931f22bf6f030c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:14:40.350443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:40.351351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-341a6997-23c1-48d5-a93c-d33161303a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:40.353199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1206/2411] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:14:40 2022] DELETE /identity/v3/projects/be362587f46c44f0931f22bf6f030c68 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:40.358236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5476-e6e8-487b-8d23-e1b7081d5b20 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:40.358526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5476-e6e8-487b-8d23-e1b7081d5b20 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:40.358800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5476-e6e8-487b-8d23-e1b7081d5b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:40.378750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-fb8d5476-e6e8-487b-8d23-e1b7081d5b20 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:40.379965 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-fb8d5476-e6e8-487b-8d23-e1b7081d5b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:40.452129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1206/2412] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:40.460280 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77690ec5-abef-4e06-99d9-a64d7a650eaf None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:40.460571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77690ec5-abef-4e06-99d9-a64d7a650eaf None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:40.460854 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77690ec5-abef-4e06-99d9-a64d7a650eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:40.478541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-77690ec5-abef-4e06-99d9-a64d7a650eaf None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:40.479725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-77690ec5-abef-4e06-99d9-a64d7a650eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:40.488026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1207/2413] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:14:40.493540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d5476-e6e8-487b-8d23-e1b7081d5b20 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:40.503400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d5476-e6e8-487b-8d23-e1b7081d5b20 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:40.509062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1868cc5-4b98-4775-8c5e-6898d53e909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:40.509729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1868cc5-4b98-4775-8c5e-6898d53e909a admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:40.510014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1868cc5-4b98-4775-8c5e-6898d53e909a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:40.510291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1868cc5-4b98-4775-8c5e-6898d53e909a admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:40.511056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1868cc5-4b98-4775-8c5e-6898d53e909a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:14:40.511363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1868cc5-4b98-4775-8c5e-6898d53e909a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:40.513008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1868cc5-4b98-4775-8c5e-6898d53e909a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:40.529223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1207/2414] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:14:40.530514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77690ec5-abef-4e06-99d9-a64d7a650eaf None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:40.540039 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77690ec5-abef-4e06-99d9-a64d7a650eaf None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:40.544734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff0b5c-2d0d-457b-bf4a-c89a28847435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:40.545892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff0b5c-2d0d-457b-bf4a-c89a28847435 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:40.545892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff0b5c-2d0d-457b-bf4a-c89a28847435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:40.546093 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff0b5c-2d0d-457b-bf4a-c89a28847435 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:40.546631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff0b5c-2d0d-457b-bf4a-c89a28847435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:40.548592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff0b5c-2d0d-457b-bf4a-c89a28847435 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:40.576265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1208/2415] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:14:40 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:40.580167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1868cc5-4b98-4775-8c5e-6898d53e909a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:40.591252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1868cc5-4b98-4775-8c5e-6898d53e909a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:40.653357 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eff1e8-64b0-44cd-876b-61d4ad308a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:40.654043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eff1e8-64b0-44cd-876b-61d4ad308a08 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:40.654327 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eff1e8-64b0-44cd-876b-61d4ad308a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:40.654718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eff1e8-64b0-44cd-876b-61d4ad308a08 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:40.655423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eff1e8-64b0-44cd-876b-61d4ad308a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:40.658145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eff1e8-64b0-44cd-876b-61d4ad308a08 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:40.691300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1208/2416] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:14:40 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:40.692897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff0b5c-2d0d-457b-bf4a-c89a28847435 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:40.705079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff0b5c-2d0d-457b-bf4a-c89a28847435 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:40.710590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532bc27-a697-4237-b492-a5052d33ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:40.711354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532bc27-a697-4237-b492-a5052d33ef82 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:40.711640 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532bc27-a697-4237-b492-a5052d33ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:40.711914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532bc27-a697-4237-b492-a5052d33ef82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:40.712709 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532bc27-a697-4237-b492-a5052d33ef82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:40.714345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532bc27-a697-4237-b492-a5052d33ef82 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:40.726585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1209/2417] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:14:40.730745 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eff1e8-64b0-44cd-876b-61d4ad308a08 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:40.741243 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eff1e8-64b0-44cd-876b-61d4ad308a08 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:40.746582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651925e0-5415-4f8c-a03c-9121797afc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:40.747297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651925e0-5415-4f8c-a03c-9121797afc6d admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:40.747554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651925e0-5415-4f8c-a03c-9121797afc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:40.747831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651925e0-5415-4f8c-a03c-9121797afc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:40.748607 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651925e0-5415-4f8c-a03c-9121797afc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:40.750225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651925e0-5415-4f8c-a03c-9121797afc6d admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:40.763153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1209/2418] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:14:40.767070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532bc27-a697-4237-b492-a5052d33ef82 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:40.784227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532bc27-a697-4237-b492-a5052d33ef82 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:40.792862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0e356-e30d-478d-b193-2bb8b8d29c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:40.794555 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0e356-e30d-478d-b193-2bb8b8d29c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:40.794949 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0e356-e30d-478d-b193-2bb8b8d29c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:40.795238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0e356-e30d-478d-b193-2bb8b8d29c74 admin admin] PATH_INFO: `/v3/projects/2073530c2a5b4ad4a6543cdfa209c9f0/users/e125d4ed850d49789402a28e4cbb58e1/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:40.825738 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0e356-e30d-478d-b193-2bb8b8d29c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2073530c2a5b4ad4a6543cdfa209c9f0, user_id=e125d4ed850d49789402a28e4cbb58e1, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:40.831168 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0e356-e30d-478d-b193-2bb8b8d29c74 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:40.864051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1210/2419] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:14:40 2022] PUT /identity/v3/projects/2073530c2a5b4ad4a6543cdfa209c9f0/users/e125d4ed850d49789402a28e4cbb58e1/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:40.871275 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b531396-7b9e-4adf-94f2-079e56c1d9fa None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:40.871275 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b531396-7b9e-4adf-94f2-079e56c1d9fa None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:40.871275 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b531396-7b9e-4adf-94f2-079e56c1d9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:40.893366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-5b531396-7b9e-4adf-94f2-079e56c1d9fa None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:40.894605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5b531396-7b9e-4adf-94f2-079e56c1d9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:40.974429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1210/2420] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:40.995567 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0e356-e30d-478d-b193-2bb8b8d29c74 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:40.998233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-39f0e356-e30d-478d-b193-2bb8b8d29c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:41.082421 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0e356-e30d-478d-b193-2bb8b8d29c74 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:41.091818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534d2fb-da33-4263-b7d6-e772ff99fb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:41.093606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534d2fb-da33-4263-b7d6-e772ff99fb4e service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:41.093972 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534d2fb-da33-4263-b7d6-e772ff99fb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:41.094322 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534d2fb-da33-4263-b7d6-e772ff99fb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:41.109298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534d2fb-da33-4263-b7d6-e772ff99fb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:41.111387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534d2fb-da33-4263-b7d6-e772ff99fb4e service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:41.124086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1211/2421] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:14:43.550625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b531396-7b9e-4adf-94f2-079e56c1d9fa None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:43.552657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5b531396-7b9e-4adf-94f2-079e56c1d9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:43.565369 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b531396-7b9e-4adf-94f2-079e56c1d9fa None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:43.570806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc487fa2-6e21-401b-98e4-b1784e5eb867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:43.571471 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc487fa2-6e21-401b-98e4-b1784e5eb867 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:43.572299 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc487fa2-6e21-401b-98e4-b1784e5eb867 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:43.572588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc487fa2-6e21-401b-98e4-b1784e5eb867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:43.574967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-fc487fa2-6e21-401b-98e4-b1784e5eb867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:43.592127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc487fa2-6e21-401b-98e4-b1784e5eb867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:43.594133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc487fa2-6e21-401b-98e4-b1784e5eb867 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:43.606334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1211/2422] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:14:45.888251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6710a1-1e26-48fd-bda2-c46b204d1dc5 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:45.889124 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6710a1-1e26-48fd-bda2-c46b204d1dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:45.889575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6710a1-1e26-48fd-bda2-c46b204d1dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:45.922400 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-bd6710a1-1e26-48fd-bda2-c46b204d1dc5 None None] MFA Rules not processed for user `e125d4ed850d49789402a28e4cbb58e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:45.923618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bd6710a1-1e26-48fd-bda2-c46b204d1dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:46.005936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1212/2423] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:46.007162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc487fa2-6e21-401b-98e4-b1784e5eb867 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:46.017773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc487fa2-6e21-401b-98e4-b1784e5eb867 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:46.023871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86062-1182-45ec-a4f7-448d1e2a84e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:46.024848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86062-1182-45ec-a4f7-448d1e2a84e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:46.025299 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86062-1182-45ec-a4f7-448d1e2a84e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:46.025718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86062-1182-45ec-a4f7-448d1e2a84e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:46.026557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86062-1182-45ec-a4f7-448d1e2a84e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:46.028641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86062-1182-45ec-a4f7-448d1e2a84e6 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:46.061390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1212/2424] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:14:46 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:46.066347 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6710a1-1e26-48fd-bda2-c46b204d1dc5 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:46.078453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6710a1-1e26-48fd-bda2-c46b204d1dc5 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:46.151070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8e69-8c5a-4046-b5dc-45256ecae4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:46.151224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8e69-8c5a-4046-b5dc-45256ecae4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:46.151484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8e69-8c5a-4046-b5dc-45256ecae4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:46.151760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8e69-8c5a-4046-b5dc-45256ecae4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:46.152866 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8e69-8c5a-4046-b5dc-45256ecae4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:46.154674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8e69-8c5a-4046-b5dc-45256ecae4d5 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:46.177992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1213/2425] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:14:46 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:14:46.182103 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86062-1182-45ec-a4f7-448d1e2a84e6 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:46.193939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86062-1182-45ec-a4f7-448d1e2a84e6 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:46.199919 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7f1f3-d7b7-4cc0-9806-e244c0d118e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:46.200677 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7f1f3-d7b7-4cc0-9806-e244c0d118e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:46.200964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7f1f3-d7b7-4cc0-9806-e244c0d118e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:46.201240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7f1f3-d7b7-4cc0-9806-e244c0d118e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:46.202132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7f1f3-d7b7-4cc0-9806-e244c0d118e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:46.203780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7f1f3-d7b7-4cc0-9806-e244c0d118e7 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:46.218864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1213/2426] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:14:46.220329 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8e69-8c5a-4046-b5dc-45256ecae4d5 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:46.231231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8e69-8c5a-4046-b5dc-45256ecae4d5 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:46.236020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806015c4-be29-49d6-b6e9-8a03a3b7b057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:46.237043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806015c4-be29-49d6-b6e9-8a03a3b7b057 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:46.237475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806015c4-be29-49d6-b6e9-8a03a3b7b057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:46.237855 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806015c4-be29-49d6-b6e9-8a03a3b7b057 admin admin] PATH_INFO: `/v3/projects/de777c06ba814ee5975856dd3f036cd3/users/0478494287aa45f9b03dcd35ff57e2ec/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:46.258442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806015c4-be29-49d6-b6e9-8a03a3b7b057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de777c06ba814ee5975856dd3f036cd3, user_id=0478494287aa45f9b03dcd35ff57e2ec, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:46.261364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806015c4-be29-49d6-b6e9-8a03a3b7b057 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:46.276325 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1214/2427] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:14:46 2022] PUT /identity/v3/projects/de777c06ba814ee5975856dd3f036cd3/users/0478494287aa45f9b03dcd35ff57e2ec/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:46.280315 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7f1f3-d7b7-4cc0-9806-e244c0d118e7 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:46.290829 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7f1f3-d7b7-4cc0-9806-e244c0d118e7 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:46.346702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8061502-35ab-4121-aaba-cda95aa816d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:46.347380 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061502-35ab-4121-aaba-cda95aa816d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:46.347670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061502-35ab-4121-aaba-cda95aa816d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:46.347946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061502-35ab-4121-aaba-cda95aa816d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:46.349742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8061502-35ab-4121-aaba-cda95aa816d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:46.350935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8061502-35ab-4121-aaba-cda95aa816d4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:46.366308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1214/2428] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:14:46.367353 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806015c4-be29-49d6-b6e9-8a03a3b7b057 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:46.377356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806015c4-be29-49d6-b6e9-8a03a3b7b057 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:46.383178 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca382-0045-4f2f-bb01-69163f66f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:46.384128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca382-0045-4f2f-bb01-69163f66f49d admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:46.384443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca382-0045-4f2f-bb01-69163f66f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:46.384725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca382-0045-4f2f-bb01-69163f66f49d admin admin] PATH_INFO: `/v3/projects/de777c06ba814ee5975856dd3f036cd3/users/0478494287aa45f9b03dcd35ff57e2ec/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:46.386702 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca382-0045-4f2f-bb01-69163f66f49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de777c06ba814ee5975856dd3f036cd3, user_id=0478494287aa45f9b03dcd35ff57e2ec, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:46.389437 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca382-0045-4f2f-bb01-69163f66f49d admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:46.401352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1215/2429] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:14:46 2022] PUT /identity/v3/projects/de777c06ba814ee5975856dd3f036cd3/users/0478494287aa45f9b03dcd35ff57e2ec/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:52.555682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8061502-35ab-4121-aaba-cda95aa816d4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:52.558537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e8061502-35ab-4121-aaba-cda95aa816d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:52.576965 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8061502-35ab-4121-aaba-cda95aa816d4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:52.651172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:52.652006 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:52.652386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:52.652571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] PATH_INFO: `/v3/users/7330cf580a8644d28bfca1eb4cb75fb4` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:52.653902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7330cf580a8644d28bfca1eb4cb75fb4)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:52.660678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:52.749277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7330cf580a8644d28bfca1eb4cb75fb4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:52.768027 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7330cf580a8644d28bfca1eb4cb75fb4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:52.783060 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7330cf580a8644d28bfca1eb4cb75fb4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:52.784686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7330cf580a8644d28bfca1eb4cb75fb4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:52.792577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7330cf580a8644d28bfca1eb4cb75fb4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:52.819905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1215/2430] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:14:52 2022] DELETE /identity/v3/users/7330cf580a8644d28bfca1eb4cb75fb4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:53.200025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8677e-f9e1-42d9-b30e-4832d66dbc8f None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:53.200616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8677e-f9e1-42d9-b30e-4832d66dbc8f None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:53.200948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8677e-f9e1-42d9-b30e-4832d66dbc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:53.216890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:53.218790 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:53.253338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-efb8677e-f9e1-42d9-b30e-4832d66dbc8f None None] MFA Rules not processed for user `0478494287aa45f9b03dcd35ff57e2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:53.255885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-efb8677e-f9e1-42d9-b30e-4832d66dbc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:53.306562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a3c9-f1af-4673-9d10-59334ac46865 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:53.311335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:53.312508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:53.312926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:53.313211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] PATH_INFO: `/v3/projects/76b64f5e92ae4a0a9f756026c2e398af` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:53.314538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b64f5e92ae4a0a9f756026c2e398af)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:53.316485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:53.335853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1216/2431] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:53.347757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8677e-f9e1-42d9-b30e-4832d66dbc8f None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:53.349140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-efb8677e-f9e1-42d9-b30e-4832d66dbc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:53.366673 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b64f5e92ae4a0a9f756026c2e398af', 'request_id': 'req-c691d700-5934-4a83-a8ee-c887c508e3a5'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.374223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b64f5e92ae4a0a9f756026c2e398af', 'request_id': 'req-c691d700-5934-4a83-a8ee-c887c508e3a5'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.381556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b64f5e92ae4a0a9f756026c2e398af', 'request_id': 'req-c691d700-5934-4a83-a8ee-c887c508e3a5'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.391131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] The token cache is being invalidate because project 76b64f5e92ae4a0a9f756026c2e398af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:14:53.391411 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.392042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.393639 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1216/2432] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:14:53 2022] DELETE /identity/v3/projects/76b64f5e92ae4a0a9f756026c2e398af => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:53.398258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:53.399547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:53.405435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8677e-f9e1-42d9-b30e-4832d66dbc8f None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:53.455303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb999f0d-d7f5-4cb4-99c7-cf312b895947 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767fe573dff349918c26995c206f2155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:53.455961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999f0d-d7f5-4cb4-99c7-cf312b895947 service glance] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:53.456297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999f0d-d7f5-4cb4-99c7-cf312b895947 service glance] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:53.456575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb999f0d-d7f5-4cb4-99c7-cf312b895947 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:53.458924 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bb999f0d-d7f5-4cb4-99c7-cf312b895947 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:53.464844 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691d700-5934-4a83-a8ee-c887c508e3a5 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:53.469834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:53.470715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:53.471001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:53.471457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] PATH_INFO: `/v3/users/7ab5bee6cb1c480a84d3a0399854b1b3` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:53.472567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab5bee6cb1c480a84d3a0399854b1b3)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:53.474871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:53.526899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb999f0d-d7f5-4cb4-99c7-cf312b895947 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:53.527588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab5bee6cb1c480a84d3a0399854b1b3'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.529393 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb999f0d-d7f5-4cb4-99c7-cf312b895947 service glance] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:53.535410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab5bee6cb1c480a84d3a0399854b1b3'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.539374 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1217/2433] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:14:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:14:53.544749 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab5bee6cb1c480a84d3a0399854b1b3'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.545438 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab5bee6cb1c480a84d3a0399854b1b3'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.546056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab5bee6cb1c480a84d3a0399854b1b3'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.564540 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1217/2434] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:14:53 2022] DELETE /identity/v3/users/7ab5bee6cb1c480a84d3a0399854b1b3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:14:53.645232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f62fb-b4f3-4f9c-ad07-3d40d89dc0a4 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:53.646027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f62fb-b4f3-4f9c-ad07-3d40d89dc0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:53.646628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f62fb-b4f3-4f9c-ad07-3d40d89dc0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:53.665394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-409f62fb-b4f3-4f9c-ad07-3d40d89dc0a4 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:14:53.666600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-409f62fb-b4f3-4f9c-ad07-3d40d89dc0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:53.726786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1218/2435] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:14:53.766402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:53.767854 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:53.823905 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f62fb-b4f3-4f9c-ad07-3d40d89dc0a4 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:14:53.825912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-409f62fb-b4f3-4f9c-ad07-3d40d89dc0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:53.844003 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76667c5-a795-4d0c-a70a-0a568a91824f admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:53.849724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:53.851035 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:53.851389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:53.851734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] PATH_INFO: `/v3/projects/8282fdb39f694827b9e9a9f6b320a132` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:53.853185 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8282fdb39f694827b9e9a9f6b320a132)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:53.855278 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:53.903642 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f62fb-b4f3-4f9c-ad07-3d40d89dc0a4 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:14:53.906297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8282fdb39f694827b9e9a9f6b320a132', 'request_id': 'req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.915999 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8282fdb39f694827b9e9a9f6b320a132', 'request_id': 'req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.923795 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8282fdb39f694827b9e9a9f6b320a132', 'request_id': 'req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.934496 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] The token cache is being invalidate because project 8282fdb39f694827b9e9a9f6b320a132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:14:53.934909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.935658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f1b9c6c8-7e2a-4aed-abcb-b03193c32c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:14:53.938010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1218/2436] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:14:53 2022] DELETE /identity/v3/projects/8282fdb39f694827b9e9a9f6b320a132 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:14:53.978367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cea096-e3e2-436f-8c5b-b59722420db7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:14:53.979065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cea096-e3e2-436f-8c5b-b59722420db7 service swift] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:14:53.979351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cea096-e3e2-436f-8c5b-b59722420db7 service swift] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:14:53.979629 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cea096-e3e2-436f-8c5b-b59722420db7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:14:53.981751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a8cea096-e3e2-436f-8c5b-b59722420db7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:14:54.058370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cea096-e3e2-436f-8c5b-b59722420db7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:14:54.060024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cea096-e3e2-436f-8c5b-b59722420db7 service swift] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:14:54.070694 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1219/2437] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:14:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 12:15:02.898414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363a0c-8420-4a32-ac5e-875ccf80eb72 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:02.898934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363a0c-8420-4a32-ac5e-875ccf80eb72 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:02.899167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363a0c-8420-4a32-ac5e-875ccf80eb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:02.917111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-00363a0c-8420-4a32-ac5e-875ccf80eb72 None None] MFA Rules not processed for user `e125d4ed850d49789402a28e4cbb58e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:15:02.918294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-00363a0c-8420-4a32-ac5e-875ccf80eb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:15:02.972995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1219/2438] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:15:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:15:06.430422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a432f1-1274-4d14-9180-15706d46dec6 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:06.430982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a432f1-1274-4d14-9180-15706d46dec6 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:06.431082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a432f1-1274-4d14-9180-15706d46dec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:06.450128 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-b2a432f1-1274-4d14-9180-15706d46dec6 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:15:06.451333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b2a432f1-1274-4d14-9180-15706d46dec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:15:06.459402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1220/2439] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:15:06.474953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363a0c-8420-4a32-ac5e-875ccf80eb72 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:15:06.476810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-00363a0c-8420-4a32-ac5e-875ccf80eb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:15:06.495657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363a0c-8420-4a32-ac5e-875ccf80eb72 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:15:06.501390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cf468-1091-4ba3-91ab-6d220f3e9ce2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:15:06.502615 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf468-1091-4ba3-91ab-6d220f3e9ce2 service swift] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:06.503184 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf468-1091-4ba3-91ab-6d220f3e9ce2 service swift] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:06.503681 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf468-1091-4ba3-91ab-6d220f3e9ce2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:06.513402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cf468-1091-4ba3-91ab-6d220f3e9ce2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:15:06.515413 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cf468-1091-4ba3-91ab-6d220f3e9ce2 service swift] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:15:06.525580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1220/2440] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:15:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 12:15:22.891040 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421af61-c343-4458-a0bb-9bfbfc9a13dd None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:22.891620 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421af61-c343-4458-a0bb-9bfbfc9a13dd None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:22.891620 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421af61-c343-4458-a0bb-9bfbfc9a13dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:22.909886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2421af61-c343-4458-a0bb-9bfbfc9a13dd None None] MFA Rules not processed for user `586e15d5d16543e6b70c87fbf9079e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:15:22.911075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2421af61-c343-4458-a0bb-9bfbfc9a13dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:15:22.964432 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1221/2441] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:15:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:15:42.072774 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b9d4f-90c7-42d5-8f42-e69a868eedb0 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:42.073293 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b9d4f-90c7-42d5-8f42-e69a868eedb0 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:42.073392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b9d4f-90c7-42d5-8f42-e69a868eedb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:42.091192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-277b9d4f-90c7-42d5-8f42-e69a868eedb0 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:15:42.092335 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-277b9d4f-90c7-42d5-8f42-e69a868eedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:15:42.099665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1221/2442] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:15:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:15:42.111916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421af61-c343-4458-a0bb-9bfbfc9a13dd None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:15:42.123943 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421af61-c343-4458-a0bb-9bfbfc9a13dd None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:15:42.128846 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d323b1-600c-45ed-9f07-601a3cbea5e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:15:42.129475 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d323b1-600c-45ed-9f07-601a3cbea5e9 service swift] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:42.129755 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d323b1-600c-45ed-9f07-601a3cbea5e9 service swift] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:42.130029 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d323b1-600c-45ed-9f07-601a3cbea5e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:42.138452 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d323b1-600c-45ed-9f07-601a3cbea5e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:15:42.140023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d323b1-600c-45ed-9f07-601a3cbea5e9 service swift] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:15:42.147869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1222/2443] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:15:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 12:15:42.749864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b9d4f-90c7-42d5-8f42-e69a868eedb0 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:15:42.751377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-277b9d4f-90c7-42d5-8f42-e69a868eedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:15:42.815682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b9d4f-90c7-42d5-8f42-e69a868eedb0 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:15:42.820046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40fd46-3f46-4ccc-a4f1-4eff87f21d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:15:42.820812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40fd46-3f46-4ccc-a4f1-4eff87f21d3b service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:42.821328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40fd46-3f46-4ccc-a4f1-4eff87f21d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:42.822022 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40fd46-3f46-4ccc-a4f1-4eff87f21d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:42.824333 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2a40fd46-3f46-4ccc-a4f1-4eff87f21d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:15:42.903216 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40fd46-3f46-4ccc-a4f1-4eff87f21d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:15:42.904690 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40fd46-3f46-4ccc-a4f1-4eff87f21d3b service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:15:42.917078 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1222/2444] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:15:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:15:56.697288 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d323b1-600c-45ed-9f07-601a3cbea5e9 service swift] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:15:56.706582 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d323b1-600c-45ed-9f07-601a3cbea5e9 service swift] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:15:56.711278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9d92f-76a9-47fa-be62-ed078ce92de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:15:56.711953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9d92f-76a9-47fa-be62-ed078ce92de8 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:56.712360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9d92f-76a9-47fa-be62-ed078ce92de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:56.712625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9d92f-76a9-47fa-be62-ed078ce92de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:56.714671 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5fd9d92f-76a9-47fa-be62-ed078ce92de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:15:56.724981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9d92f-76a9-47fa-be62-ed078ce92de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:15:56.726658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9d92f-76a9-47fa-be62-ed078ce92de8 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:15:56.736937 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1223/2445] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:15:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:15:56.838432 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9db649-eeb3-426a-b12c-fa50ac09ec6a None None] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:56.838922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9db649-eeb3-426a-b12c-fa50ac09ec6a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:56.839059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9db649-eeb3-426a-b12c-fa50ac09ec6a None None] PATH_INFO: `/` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:56.840560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1223/2446] 10.222.0.58 () {54 vars in 921 bytes} [Tue May 17 12:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 12:15:56.845750 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82900c-27c5-49d7-b7f2-b5a49159d2be None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:56.846043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82900c-27c5-49d7-b7f2-b5a49159d2be None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:56.846371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82900c-27c5-49d7-b7f2-b5a49159d2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:56.866561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-fa82900c-27c5-49d7-b7f2-b5a49159d2be None None] MFA Rules not processed for user `d86479ff40f54e7793f1771cb6ad362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:15:56.867706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-fa82900c-27c5-49d7-b7f2-b5a49159d2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:15:56.937291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1224/2447] 10.222.0.58 () {58 vars in 1018 bytes} [Tue May 17 12:15:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:15:56.949084 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9db649-eeb3-426a-b12c-fa50ac09ec6a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:15:56.951556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-7f9db649-eeb3-426a-b12c-fa50ac09ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:15:57.008713 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9db649-eeb3-426a-b12c-fa50ac09ec6a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:15:57.012272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8df6e-b599-4da2-a0e4-29319564efaa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767fe573dff349918c26995c206f2155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:15:57.012924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8df6e-b599-4da2-a0e4-29319564efaa service glance] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:57.013215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8df6e-b599-4da2-a0e4-29319564efaa service glance] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:57.013493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8df6e-b599-4da2-a0e4-29319564efaa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:57.023989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8df6e-b599-4da2-a0e4-29319564efaa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:15:57.025445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8df6e-b599-4da2-a0e4-29319564efaa service glance] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:15:57.035846 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1224/2448] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:15:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:15:58.849732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804d876-4482-40f7-9a83-1662c9b1e485 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:58.850315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804d876-4482-40f7-9a83-1662c9b1e485 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:58.850315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804d876-4482-40f7-9a83-1662c9b1e485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:58.867710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f804d876-4482-40f7-9a83-1662c9b1e485 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:15:58.868959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f804d876-4482-40f7-9a83-1662c9b1e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:15:58.876002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1225/2449] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:15:58.898381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8df6e-b599-4da2-a0e4-29319564efaa service glance] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:15:58.909397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8df6e-b599-4da2-a0e4-29319564efaa service glance] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:15:58.914361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30269d82-e055-48fc-85df-02abaeec8de3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:15:58.914994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269d82-e055-48fc-85df-02abaeec8de3 service swift] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:15:58.915277 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269d82-e055-48fc-85df-02abaeec8de3 service swift] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:15:58.915553 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30269d82-e055-48fc-85df-02abaeec8de3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:15:58.923323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30269d82-e055-48fc-85df-02abaeec8de3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:15:58.924923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30269d82-e055-48fc-85df-02abaeec8de3 service swift] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:15:58.932803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1225/2450] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:15:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 12:16:18.046052 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804d876-4482-40f7-9a83-1662c9b1e485 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:18.047515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f804d876-4482-40f7-9a83-1662c9b1e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:16:18.059372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804d876-4482-40f7-9a83-1662c9b1e485 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:18.062876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3c717-483c-41a6-8d72-a74247a7de7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:18.063504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3c717-483c-41a6-8d72-a74247a7de7d service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:18.063786 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3c717-483c-41a6-8d72-a74247a7de7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:18.064061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3c717-483c-41a6-8d72-a74247a7de7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:18.066054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b8a3c717-483c-41a6-8d72-a74247a7de7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:16:18.078879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3c717-483c-41a6-8d72-a74247a7de7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:18.080984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3c717-483c-41a6-8d72-a74247a7de7d service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:18.091565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1226/2451] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:16:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:16:20.429580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30269d82-e055-48fc-85df-02abaeec8de3 service swift] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:20.440211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30269d82-e055-48fc-85df-02abaeec8de3 service swift] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:20.443992 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d65683-aa2d-4abe-b223-541b2913eee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:20.444656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d65683-aa2d-4abe-b223-541b2913eee5 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:20.444942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d65683-aa2d-4abe-b223-541b2913eee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:20.445219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d65683-aa2d-4abe-b223-541b2913eee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:20.446993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-96d65683-aa2d-4abe-b223-541b2913eee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:16:20.460683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d65683-aa2d-4abe-b223-541b2913eee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:20.462110 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d65683-aa2d-4abe-b223-541b2913eee5 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:20.472922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1226/2452] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:16:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:16:20.816546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b42a7-b499-4968-9693-e24f1c671c53 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:20.816987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b42a7-b499-4968-9693-e24f1c671c53 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:20.817114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b42a7-b499-4968-9693-e24f1c671c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:20.834654 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-aa9b42a7-b499-4968-9693-e24f1c671c53 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:16:20.835871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-aa9b42a7-b499-4968-9693-e24f1c671c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:16:20.843023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1227/2453] 10.222.0.58 () {58 vars in 967 bytes} [Tue May 17 12:16:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:16:20.856068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d65683-aa2d-4abe-b223-541b2913eee5 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:20.870328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d65683-aa2d-4abe-b223-541b2913eee5 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:20.875373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957524c4-8fda-4019-bc48-674430790650 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:20.876017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957524c4-8fda-4019-bc48-674430790650 service swift] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:20.876346 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957524c4-8fda-4019-bc48-674430790650 service swift] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:20.876628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957524c4-8fda-4019-bc48-674430790650 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:20.885797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957524c4-8fda-4019-bc48-674430790650 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:20.887541 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957524c4-8fda-4019-bc48-674430790650 service swift] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:20.895886 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1227/2454] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:16:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 12:16:46.289070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b42a7-b499-4968-9693-e24f1c671c53 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:46.298097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b42a7-b499-4968-9693-e24f1c671c53 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:46.302342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13478e18-6d20-4318-8810-b5d122fad7ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:46.302911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13478e18-6d20-4318-8810-b5d122fad7ba service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:46.303253 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13478e18-6d20-4318-8810-b5d122fad7ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:46.303529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13478e18-6d20-4318-8810-b5d122fad7ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:46.305338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-13478e18-6d20-4318-8810-b5d122fad7ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:16:46.365488 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13478e18-6d20-4318-8810-b5d122fad7ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:46.366942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13478e18-6d20-4318-8810-b5d122fad7ba service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:46.376251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1228/2455] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:16:49.440848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957524c4-8fda-4019-bc48-674430790650 service swift] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:49.442964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-957524c4-8fda-4019-bc48-674430790650 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:16:49.461952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957524c4-8fda-4019-bc48-674430790650 service swift] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:49.466525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079b260-b032-48ef-860e-c8ef5bf44007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:49.467386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079b260-b032-48ef-860e-c8ef5bf44007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:49.467671 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079b260-b032-48ef-860e-c8ef5bf44007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:49.467950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079b260-b032-48ef-860e-c8ef5bf44007 admin admin] PATH_INFO: `/v3/users/79ff688720854ad1b62b3c9b51546e0f` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:49.481770 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079b260-b032-48ef-860e-c8ef5bf44007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ff688720854ad1b62b3c9b51546e0f)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:49.483694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079b260-b032-48ef-860e-c8ef5bf44007 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:49.529101 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6079b260-b032-48ef-860e-c8ef5bf44007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ff688720854ad1b62b3c9b51546e0f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:16:49.535894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6079b260-b032-48ef-860e-c8ef5bf44007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ff688720854ad1b62b3c9b51546e0f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:16:49.543278 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6079b260-b032-48ef-860e-c8ef5bf44007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ff688720854ad1b62b3c9b51546e0f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:16:49.543939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6079b260-b032-48ef-860e-c8ef5bf44007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ff688720854ad1b62b3c9b51546e0f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:16:49.544563 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-6079b260-b032-48ef-860e-c8ef5bf44007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ff688720854ad1b62b3c9b51546e0f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:16:49.561935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1228/2456] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:16:49 2022] DELETE /identity/v3/users/79ff688720854ad1b62b3c9b51546e0f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:16:49.729575 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13478e18-6d20-4318-8810-b5d122fad7ba service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:49.740563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13478e18-6d20-4318-8810-b5d122fad7ba service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:49.795091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:49.795941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:49.796257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:49.796537 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] PATH_INFO: `/v3/projects/2ae797920785457f975f9f85d80849af` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:49.807458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae797920785457f975f9f85d80849af)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:49.809397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:49.856275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae797920785457f975f9f85d80849af', 'request_id': 'req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:16:49.862731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae797920785457f975f9f85d80849af', 'request_id': 'req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:16:49.868805 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae797920785457f975f9f85d80849af', 'request_id': 'req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:16:49.880644 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] The token cache is being invalidate because project 2ae797920785457f975f9f85d80849af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:16:49.880935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:16:49.881546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-51b6c81c-0d4b-4ec9-9a57-5b3c1759a7af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:16:49.883097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1229/2457] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:16:49 2022] DELETE /identity/v3/projects/2ae797920785457f975f9f85d80849af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:16:49.888215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b0296-b785-4a0a-a8d1-9f6014db93f7 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:49.888511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b0296-b785-4a0a-a8d1-9f6014db93f7 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:49.888786 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b0296-b785-4a0a-a8d1-9f6014db93f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:49.905864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f73b0296-b785-4a0a-a8d1-9f6014db93f7 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:16:49.907055 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f73b0296-b785-4a0a-a8d1-9f6014db93f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:16:49.964607 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1229/2458] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:16:49.972483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843bd5e-10ef-470f-9d50-9cf333c57993 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:49.972721 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843bd5e-10ef-470f-9d50-9cf333c57993 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:49.973026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843bd5e-10ef-470f-9d50-9cf333c57993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:49.991663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-6843bd5e-10ef-470f-9d50-9cf333c57993 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:16:49.992878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6843bd5e-10ef-470f-9d50-9cf333c57993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:16:50.000643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1230/2459] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:16:50.004715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b0296-b785-4a0a-a8d1-9f6014db93f7 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.014102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b0296-b785-4a0a-a8d1-9f6014db93f7 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.018574 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d3d4d-66cb-4f99-ad44-fec882a51816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.019214 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d3d4d-66cb-4f99-ad44-fec882a51816 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.019494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d3d4d-66cb-4f99-ad44-fec882a51816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.019768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d3d4d-66cb-4f99-ad44-fec882a51816 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.020561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d3d4d-66cb-4f99-ad44-fec882a51816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:16:50.021030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d3d4d-66cb-4f99-ad44-fec882a51816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.022603 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d3d4d-66cb-4f99-ad44-fec882a51816 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.033670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1230/2460] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:16:50.038338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843bd5e-10ef-470f-9d50-9cf333c57993 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.047328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843bd5e-10ef-470f-9d50-9cf333c57993 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.052478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f20728-61ad-4e37-8a47-4cbf57f8fe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.053110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f20728-61ad-4e37-8a47-4cbf57f8fe3e admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.053390 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f20728-61ad-4e37-8a47-4cbf57f8fe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.053664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f20728-61ad-4e37-8a47-4cbf57f8fe3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.054378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f20728-61ad-4e37-8a47-4cbf57f8fe3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.056298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f20728-61ad-4e37-8a47-4cbf57f8fe3e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.081018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1231/2461] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:16:50 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:16:50.085824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d3d4d-66cb-4f99-ad44-fec882a51816 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.098798 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d3d4d-66cb-4f99-ad44-fec882a51816 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.154137 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9b2ce-fa00-41f7-b50d-1295d50d4d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.154799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9b2ce-fa00-41f7-b50d-1295d50d4d3b admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.155094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9b2ce-fa00-41f7-b50d-1295d50d4d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.155368 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9b2ce-fa00-41f7-b50d-1295d50d4d3b admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.156057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9b2ce-fa00-41f7-b50d-1295d50d4d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.158011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9b2ce-fa00-41f7-b50d-1295d50d4d3b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.178252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1231/2462] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:16:50 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:16:50.182580 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f20728-61ad-4e37-8a47-4cbf57f8fe3e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.192768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f20728-61ad-4e37-8a47-4cbf57f8fe3e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.197319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5767768-3fc3-47fd-a46c-fb9e98a95dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.197969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5767768-3fc3-47fd-a46c-fb9e98a95dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.198254 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5767768-3fc3-47fd-a46c-fb9e98a95dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.198533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5767768-3fc3-47fd-a46c-fb9e98a95dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.199255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5767768-3fc3-47fd-a46c-fb9e98a95dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.201149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5767768-3fc3-47fd-a46c-fb9e98a95dc6 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.211939 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1232/2463] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:16:50.215764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9b2ce-fa00-41f7-b50d-1295d50d4d3b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.226322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9b2ce-fa00-41f7-b50d-1295d50d4d3b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.237437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c5912-3054-4ddc-8db0-510547eaec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.238094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c5912-3054-4ddc-8db0-510547eaec86 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.238381 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c5912-3054-4ddc-8db0-510547eaec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.238658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c5912-3054-4ddc-8db0-510547eaec86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.239662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c5912-3054-4ddc-8db0-510547eaec86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.241322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c5912-3054-4ddc-8db0-510547eaec86 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.251198 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1232/2464] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:16:50.255281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5767768-3fc3-47fd-a46c-fb9e98a95dc6 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.265432 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5767768-3fc3-47fd-a46c-fb9e98a95dc6 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.270048 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc663ec-84ab-4e16-90e4-58100c592780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.271527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc663ec-84ab-4e16-90e4-58100c592780 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.271820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc663ec-84ab-4e16-90e4-58100c592780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.272095 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc663ec-84ab-4e16-90e4-58100c592780 admin admin] PATH_INFO: `/v3/projects/d66e3f102883497c8f3573a85bd3eb8c/users/22aae46037894e4c8a914ab5031ac0f3/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.287518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc663ec-84ab-4e16-90e4-58100c592780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66e3f102883497c8f3573a85bd3eb8c, user_id=22aae46037894e4c8a914ab5031ac0f3, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.290210 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc663ec-84ab-4e16-90e4-58100c592780 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.302512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1233/2465] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:16:50 2022] PUT /identity/v3/projects/d66e3f102883497c8f3573a85bd3eb8c/users/22aae46037894e4c8a914ab5031ac0f3/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:16:50.313121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570945f7-dcac-4c10-be67-ad69ca2aeabe None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.313415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570945f7-dcac-4c10-be67-ad69ca2aeabe None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.313695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570945f7-dcac-4c10-be67-ad69ca2aeabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.339967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-570945f7-dcac-4c10-be67-ad69ca2aeabe None None] MFA Rules not processed for user `22aae46037894e4c8a914ab5031ac0f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:16:50.341196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-570945f7-dcac-4c10-be67-ad69ca2aeabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:16:50.403030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1233/2466] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:16:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:16:50.407680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc663ec-84ab-4e16-90e4-58100c592780 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.466797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc663ec-84ab-4e16-90e4-58100c592780 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.471359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923aff1-cafb-4382-be5d-4a5c5becef70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.472010 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923aff1-cafb-4382-be5d-4a5c5becef70 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.472353 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923aff1-cafb-4382-be5d-4a5c5becef70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.472635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923aff1-cafb-4382-be5d-4a5c5becef70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.473892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923aff1-cafb-4382-be5d-4a5c5becef70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.475879 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923aff1-cafb-4382-be5d-4a5c5becef70 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.500044 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1234/2467] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:16:50 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:16:50.504089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570945f7-dcac-4c10-be67-ad69ca2aeabe None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.514626 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570945f7-dcac-4c10-be67-ad69ca2aeabe None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.570527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cad85-2bd3-4f5b-a3bf-9bcbe660f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.571193 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cad85-2bd3-4f5b-a3bf-9bcbe660f52f admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.571485 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cad85-2bd3-4f5b-a3bf-9bcbe660f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.571757 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cad85-2bd3-4f5b-a3bf-9bcbe660f52f admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.572475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cad85-2bd3-4f5b-a3bf-9bcbe660f52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.574389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cad85-2bd3-4f5b-a3bf-9bcbe660f52f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.595030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1234/2468] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:16:50 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:16:50.599602 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923aff1-cafb-4382-be5d-4a5c5becef70 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.609496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923aff1-cafb-4382-be5d-4a5c5becef70 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.614152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aaf35-7a21-4a48-9b4a-7cf31ca6dd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.614797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aaf35-7a21-4a48-9b4a-7cf31ca6dd1e admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.615074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aaf35-7a21-4a48-9b4a-7cf31ca6dd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.615348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aaf35-7a21-4a48-9b4a-7cf31ca6dd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.616059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aaf35-7a21-4a48-9b4a-7cf31ca6dd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.617683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aaf35-7a21-4a48-9b4a-7cf31ca6dd1e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.628686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1235/2469] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:16:50.633509 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cad85-2bd3-4f5b-a3bf-9bcbe660f52f admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.643258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cad85-2bd3-4f5b-a3bf-9bcbe660f52f admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.649005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd8ab-6038-4085-82aa-d3d734c5c419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.650047 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd8ab-6038-4085-82aa-d3d734c5c419 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.650345 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd8ab-6038-4085-82aa-d3d734c5c419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.650629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd8ab-6038-4085-82aa-d3d734c5c419 admin admin] PATH_INFO: `/v3/projects/78d0994d2a464f7cbde08aec6763f413/users/f0657522de884bc7a8c87b7c7088bffe/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.666375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbd8ab-6038-4085-82aa-d3d734c5c419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d0994d2a464f7cbde08aec6763f413, user_id=f0657522de884bc7a8c87b7c7088bffe, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.669047 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbd8ab-6038-4085-82aa-d3d734c5c419 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.681577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1235/2470] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:16:50 2022] PUT /identity/v3/projects/78d0994d2a464f7cbde08aec6763f413/users/f0657522de884bc7a8c87b7c7088bffe/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:16:50.685544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aaf35-7a21-4a48-9b4a-7cf31ca6dd1e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.695888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aaf35-7a21-4a48-9b4a-7cf31ca6dd1e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.752501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5dc49-fa14-42bd-aa5d-38518c7121ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.753110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5dc49-fa14-42bd-aa5d-38518c7121ac admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.753386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5dc49-fa14-42bd-aa5d-38518c7121ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.753667 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5dc49-fa14-42bd-aa5d-38518c7121ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.754397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5dc49-fa14-42bd-aa5d-38518c7121ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.756710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5dc49-fa14-42bd-aa5d-38518c7121ac admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.766673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1236/2471] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:16:50.771609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd8ab-6038-4085-82aa-d3d734c5c419 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.781876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd8ab-6038-4085-82aa-d3d734c5c419 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.786675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7bf8a-f98f-484c-9b9d-32c57f043840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.787548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7bf8a-f98f-484c-9b9d-32c57f043840 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.787834 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7bf8a-f98f-484c-9b9d-32c57f043840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.788107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7bf8a-f98f-484c-9b9d-32c57f043840 admin admin] PATH_INFO: `/v3/projects/78d0994d2a464f7cbde08aec6763f413/users/f0657522de884bc7a8c87b7c7088bffe/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.790172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7bf8a-f98f-484c-9b9d-32c57f043840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d0994d2a464f7cbde08aec6763f413, user_id=f0657522de884bc7a8c87b7c7088bffe, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.792830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7bf8a-f98f-484c-9b9d-32c57f043840 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:50.802858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1236/2472] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:16:50 2022] PUT /identity/v3/projects/78d0994d2a464f7cbde08aec6763f413/users/f0657522de884bc7a8c87b7c7088bffe/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:16:50.812894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc311cb-c1d5-4d65-9d0e-3bd5bd5508d3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.813183 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc311cb-c1d5-4d65-9d0e-3bd5bd5508d3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.813458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc311cb-c1d5-4d65-9d0e-3bd5bd5508d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.839891 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-4fc311cb-c1d5-4d65-9d0e-3bd5bd5508d3 None None] MFA Rules not processed for user `f0657522de884bc7a8c87b7c7088bffe`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:16:50.841109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4fc311cb-c1d5-4d65-9d0e-3bd5bd5508d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:16:50.905824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1237/2473] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:16:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:16:50.917621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7bf8a-f98f-484c-9b9d-32c57f043840 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:50.919323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a6e7bf8a-f98f-484c-9b9d-32c57f043840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:16:50.977573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7bf8a-f98f-484c-9b9d-32c57f043840 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:50.981305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181102d-4863-4ab6-838e-09624a560333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:50.981943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181102d-4863-4ab6-838e-09624a560333 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:50.982225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181102d-4863-4ab6-838e-09624a560333 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:50.982517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181102d-4863-4ab6-838e-09624a560333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:50.991632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181102d-4863-4ab6-838e-09624a560333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:50.993097 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181102d-4863-4ab6-838e-09624a560333 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:51.002218 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1237/2474] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:16:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:16:51.073225 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc311cb-c1d5-4d65-9d0e-3bd5bd5508d3 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:16:51.083413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc311cb-c1d5-4d65-9d0e-3bd5bd5508d3 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:16:51.087174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183a54-4cc9-4042-9cd4-280f94ed32ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:16:51.087816 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183a54-4cc9-4042-9cd4-280f94ed32ed service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:16:51.088103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183a54-4cc9-4042-9cd4-280f94ed32ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:16:51.088406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1183a54-4cc9-4042-9cd4-280f94ed32ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:16:51.143290 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1183a54-4cc9-4042-9cd4-280f94ed32ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:16:51.144773 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1183a54-4cc9-4042-9cd4-280f94ed32ed service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:16:51.154815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1238/2475] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:16:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:01.850278 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181102d-4863-4ab6-838e-09624a560333 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:01.851791 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c181102d-4863-4ab6-838e-09624a560333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:01.911169 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181102d-4863-4ab6-838e-09624a560333 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:01.914758 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35f611-7037-48d7-afaf-fdfe97eda19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:01.915403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35f611-7037-48d7-afaf-fdfe97eda19e service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:01.915685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35f611-7037-48d7-afaf-fdfe97eda19e service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:01.915962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35f611-7037-48d7-afaf-fdfe97eda19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:01.917801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0c35f611-7037-48d7-afaf-fdfe97eda19e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:01.927857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35f611-7037-48d7-afaf-fdfe97eda19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:01.929461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35f611-7037-48d7-afaf-fdfe97eda19e service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:01.937398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1238/2476] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:02.274270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183a54-4cc9-4042-9cd4-280f94ed32ed service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:02.337996 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1183a54-4cc9-4042-9cd4-280f94ed32ed service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:02.342487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:02.343354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:02.343633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:02.343907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] PATH_INFO: `/v3/users/22aae46037894e4c8a914ab5031ac0f3` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:02.345246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=22aae46037894e4c8a914ab5031ac0f3)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:02.347058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:02.396422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22aae46037894e4c8a914ab5031ac0f3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:02.397072 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22aae46037894e4c8a914ab5031ac0f3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:02.403677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22aae46037894e4c8a914ab5031ac0f3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:02.411222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22aae46037894e4c8a914ab5031ac0f3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:02.411886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22aae46037894e4c8a914ab5031ac0f3'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:02.429178 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1239/2477] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:02 2022] DELETE /identity/v3/users/22aae46037894e4c8a914ab5031ac0f3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:02.433490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398869d1-8e3a-4bd8-91d3-73f47b817897 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:02.433712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398869d1-8e3a-4bd8-91d3-73f47b817897 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:02.434044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398869d1-8e3a-4bd8-91d3-73f47b817897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:02.451326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-398869d1-8e3a-4bd8-91d3-73f47b817897 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:02.452575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-398869d1-8e3a-4bd8-91d3-73f47b817897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:02.512126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1239/2478] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:02.522373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:02.523779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:02.581031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f97523-ab99-48bd-99bc-f3343dd1da4d admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:02.585276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5f907-5a18-4cf1-8190-2764386e62ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:02.586166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5f907-5a18-4cf1-8190-2764386e62ac service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:02.586492 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5f907-5a18-4cf1-8190-2764386e62ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:02.586841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5f907-5a18-4cf1-8190-2764386e62ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:02.598939 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5f907-5a18-4cf1-8190-2764386e62ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:02.600633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5f907-5a18-4cf1-8190-2764386e62ac service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:02.611200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1240/2479] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:02.875847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398869d1-8e3a-4bd8-91d3-73f47b817897 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:02.877346 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-398869d1-8e3a-4bd8-91d3-73f47b817897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:02.891660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398869d1-8e3a-4bd8-91d3-73f47b817897 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:02.897974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:02.898850 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:02.899186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:02.899391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] PATH_INFO: `/v3/projects/d66e3f102883497c8f3573a85bd3eb8c` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:02.900718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66e3f102883497c8f3573a85bd3eb8c)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:02.902523 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:02.948839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66e3f102883497c8f3573a85bd3eb8c', 'request_id': 'req-01cd3dae-e298-41e2-b18d-736867811ca6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:02.957210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66e3f102883497c8f3573a85bd3eb8c', 'request_id': 'req-01cd3dae-e298-41e2-b18d-736867811ca6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:02.964756 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66e3f102883497c8f3573a85bd3eb8c', 'request_id': 'req-01cd3dae-e298-41e2-b18d-736867811ca6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:02.974859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] The token cache is being invalidate because project d66e3f102883497c8f3573a85bd3eb8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:17:02.975145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:02.975856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:02.977612 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1240/2480] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:17:02 2022] DELETE /identity/v3/projects/d66e3f102883497c8f3573a85bd3eb8c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:02.981546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5f907-5a18-4cf1-8190-2764386e62ac service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:02.991961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5f907-5a18-4cf1-8190-2764386e62ac service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:03.047574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a8da5-6629-40f1-873c-b9002106455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:03.048480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8da5-6629-40f1-873c-b9002106455a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:03.048766 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8da5-6629-40f1-873c-b9002106455a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:03.049041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a8da5-6629-40f1-873c-b9002106455a admin admin] PATH_INFO: `/v3/users/f0657522de884bc7a8c87b7c7088bffe` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:03.050221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a8da5-6629-40f1-873c-b9002106455a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0657522de884bc7a8c87b7c7088bffe)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:03.052872 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a8da5-6629-40f1-873c-b9002106455a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:03.099551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-762a8da5-6629-40f1-873c-b9002106455a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0657522de884bc7a8c87b7c7088bffe'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:03.100238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-762a8da5-6629-40f1-873c-b9002106455a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0657522de884bc7a8c87b7c7088bffe'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:03.107078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-762a8da5-6629-40f1-873c-b9002106455a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0657522de884bc7a8c87b7c7088bffe'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:03.114850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-762a8da5-6629-40f1-873c-b9002106455a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0657522de884bc7a8c87b7c7088bffe'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:03.115616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-762a8da5-6629-40f1-873c-b9002106455a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0657522de884bc7a8c87b7c7088bffe'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:03.133062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1241/2481] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:02 2022] DELETE /identity/v3/users/f0657522de884bc7a8c87b7c7088bffe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:03.400691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:03.402143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:03.414813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd3dae-e298-41e2-b18d-736867811ca6 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:03.470560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:03.471416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:03.471699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:03.471974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] PATH_INFO: `/v3/projects/78d0994d2a464f7cbde08aec6763f413` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:03.473202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78d0994d2a464f7cbde08aec6763f413)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:03.475107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:03.518906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78d0994d2a464f7cbde08aec6763f413', 'request_id': 'req-7e876335-66d1-4e8e-bbee-cb44e56eea88'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:03.527575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78d0994d2a464f7cbde08aec6763f413', 'request_id': 'req-7e876335-66d1-4e8e-bbee-cb44e56eea88'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:03.534077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78d0994d2a464f7cbde08aec6763f413', 'request_id': 'req-7e876335-66d1-4e8e-bbee-cb44e56eea88'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:03.543964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] The token cache is being invalidate because project 78d0994d2a464f7cbde08aec6763f413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:17:03.544272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:03.544907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-7e876335-66d1-4e8e-bbee-cb44e56eea88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:03.546425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1241/2482] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:17:03 2022] DELETE /identity/v3/projects/78d0994d2a464f7cbde08aec6763f413 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:03.551668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992cb3-57eb-4977-889c-672866b7468c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:03.552137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992cb3-57eb-4977-889c-672866b7468c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:03.552264 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992cb3-57eb-4977-889c-672866b7468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:03.571001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-0d992cb3-57eb-4977-889c-672866b7468c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:03.572221 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-0d992cb3-57eb-4977-889c-672866b7468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:03.630391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1242/2483] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:03.638253 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a8a8e-e9d2-4ff4-a26d-f70edf56dda4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:03.638547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a8a8e-e9d2-4ff4-a26d-f70edf56dda4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:03.638826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a8a8e-e9d2-4ff4-a26d-f70edf56dda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:03.657475 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-6f5a8a8e-e9d2-4ff4-a26d-f70edf56dda4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:03.658670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6f5a8a8e-e9d2-4ff4-a26d-f70edf56dda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:03.666878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1242/2484] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:03.671044 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d992cb3-57eb-4977-889c-672866b7468c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:03.680731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d992cb3-57eb-4977-889c-672866b7468c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:03.685310 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ecada-9dbd-4649-a4c7-fc74c9835a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:03.685992 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ecada-9dbd-4649-a4c7-fc74c9835a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:03.686281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ecada-9dbd-4649-a4c7-fc74c9835a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:03.686564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ecada-9dbd-4649-a4c7-fc74c9835a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:03.687326 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ecada-9dbd-4649-a4c7-fc74c9835a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:17:03.687637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ecada-9dbd-4649-a4c7-fc74c9835a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:03.689301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ecada-9dbd-4649-a4c7-fc74c9835a97 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:03.701518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1243/2485] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:17:03.705636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a8a8e-e9d2-4ff4-a26d-f70edf56dda4 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:03.715481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a8a8e-e9d2-4ff4-a26d-f70edf56dda4 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:03.720082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d04a4-4708-4119-9a3b-f25db0a951a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:03.720753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d04a4-4708-4119-9a3b-f25db0a951a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:03.721034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d04a4-4708-4119-9a3b-f25db0a951a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:03.721308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d04a4-4708-4119-9a3b-f25db0a951a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:03.722021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d04a4-4708-4119-9a3b-f25db0a951a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:03.724033 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d04a4-4708-4119-9a3b-f25db0a951a4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:03.748971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1243/2486] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:17:03 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:17:03.753077 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ecada-9dbd-4649-a4c7-fc74c9835a97 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:03.764427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ecada-9dbd-4649-a4c7-fc74c9835a97 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:03.819499 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a66f9-8a44-45e8-b30a-7e9a4f17fa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:03.820091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a66f9-8a44-45e8-b30a-7e9a4f17fa60 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:03.820409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a66f9-8a44-45e8-b30a-7e9a4f17fa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:03.820690 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a66f9-8a44-45e8-b30a-7e9a4f17fa60 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:03.821381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a66f9-8a44-45e8-b30a-7e9a4f17fa60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:03.823300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a66f9-8a44-45e8-b30a-7e9a4f17fa60 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:03.842904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1244/2487] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:17:03 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:17:03.846889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d04a4-4708-4119-9a3b-f25db0a951a4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:03.856978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d04a4-4708-4119-9a3b-f25db0a951a4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:03.861768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b8e6-c23c-4c49-843b-fb0044600f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:03.862419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b8e6-c23c-4c49-843b-fb0044600f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:03.862699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b8e6-c23c-4c49-843b-fb0044600f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:03.862974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6b8e6-c23c-4c49-843b-fb0044600f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:03.864205 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6b8e6-c23c-4c49-843b-fb0044600f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:03.865897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6b8e6-c23c-4c49-843b-fb0044600f65 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:03.875982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1244/2488] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:03.880485 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a66f9-8a44-45e8-b30a-7e9a4f17fa60 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:03.890096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a66f9-8a44-45e8-b30a-7e9a4f17fa60 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:03.894567 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdc1a6-557b-4cb4-9640-e313da7d27c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:03.896029 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc1a6-557b-4cb4-9640-e313da7d27c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:03.896370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc1a6-557b-4cb4-9640-e313da7d27c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:03.896650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc1a6-557b-4cb4-9640-e313da7d27c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:03.897372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdc1a6-557b-4cb4-9640-e313da7d27c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:03.898961 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdc1a6-557b-4cb4-9640-e313da7d27c2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:03.908831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1245/2489] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:17:03.913613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b8e6-c23c-4c49-843b-fb0044600f65 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:03.923319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6b8e6-c23c-4c49-843b-fb0044600f65 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:03.927975 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29205e-1267-4a90-853a-7e34983e8eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:03.928878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29205e-1267-4a90-853a-7e34983e8eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:03.929161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29205e-1267-4a90-853a-7e34983e8eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:03.929438 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29205e-1267-4a90-853a-7e34983e8eb5 admin admin] PATH_INFO: `/v3/projects/f79fbab2842248d389c125caa44ba358/users/0dff3397a82c445ab713ae5859cadf41/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:03.943744 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29205e-1267-4a90-853a-7e34983e8eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79fbab2842248d389c125caa44ba358, user_id=0dff3397a82c445ab713ae5859cadf41, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:03.946397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29205e-1267-4a90-853a-7e34983e8eb5 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:03.959957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1245/2490] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:03 2022] PUT /identity/v3/projects/f79fbab2842248d389c125caa44ba358/users/0dff3397a82c445ab713ae5859cadf41/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:03.971047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b725d-a11d-4627-803c-791d70334ca9 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:03.971366 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b725d-a11d-4627-803c-791d70334ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:03.971648 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b725d-a11d-4627-803c-791d70334ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:03.997948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7b1b725d-a11d-4627-803c-791d70334ca9 None None] MFA Rules not processed for user `0dff3397a82c445ab713ae5859cadf41`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:03.999143 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7b1b725d-a11d-4627-803c-791d70334ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:04.061900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1246/2491] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:04.066532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29205e-1267-4a90-853a-7e34983e8eb5 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:04.126254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29205e-1267-4a90-853a-7e34983e8eb5 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:04.131810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd74835-f6a1-456e-bccb-302098e64716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:04.132572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd74835-f6a1-456e-bccb-302098e64716 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:04.132857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd74835-f6a1-456e-bccb-302098e64716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:04.133135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd74835-f6a1-456e-bccb-302098e64716 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:04.133835 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd74835-f6a1-456e-bccb-302098e64716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:04.135986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd74835-f6a1-456e-bccb-302098e64716 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:04.163379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1246/2492] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:17:04 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:17:04.167162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b725d-a11d-4627-803c-791d70334ca9 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:04.178175 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b725d-a11d-4627-803c-791d70334ca9 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:04.235617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e82bde-bc86-4de4-80cf-711a0d5f42a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:04.236331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e82bde-bc86-4de4-80cf-711a0d5f42a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:04.236618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e82bde-bc86-4de4-80cf-711a0d5f42a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:04.236896 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e82bde-bc86-4de4-80cf-711a0d5f42a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:04.237592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e82bde-bc86-4de4-80cf-711a0d5f42a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:04.239691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e82bde-bc86-4de4-80cf-711a0d5f42a5 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:04.260322 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1247/2493] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:17:04 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:17:04.264533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd74835-f6a1-456e-bccb-302098e64716 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:04.274780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd74835-f6a1-456e-bccb-302098e64716 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:04.279852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda790b0-3f28-4e4b-95b5-17a8d410b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:04.280555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda790b0-3f28-4e4b-95b5-17a8d410b3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:04.280841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda790b0-3f28-4e4b-95b5-17a8d410b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:04.281119 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda790b0-3f28-4e4b-95b5-17a8d410b3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:04.281859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda790b0-3f28-4e4b-95b5-17a8d410b3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:04.283461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda790b0-3f28-4e4b-95b5-17a8d410b3bc admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:04.295093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1247/2494] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:04.299148 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e82bde-bc86-4de4-80cf-711a0d5f42a5 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:04.309604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e82bde-bc86-4de4-80cf-711a0d5f42a5 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:04.314113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96656fe9-492c-4c88-ad10-9f0324be9d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:04.314984 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96656fe9-492c-4c88-ad10-9f0324be9d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:04.315270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96656fe9-492c-4c88-ad10-9f0324be9d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:04.315547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96656fe9-492c-4c88-ad10-9f0324be9d98 admin admin] PATH_INFO: `/v3/projects/7990a2e84b3a496ca6151112d0bfbfde/users/e8fb8ef6175c4abcafdf59c6c7882382/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:04.330224 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96656fe9-492c-4c88-ad10-9f0324be9d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7990a2e84b3a496ca6151112d0bfbfde, user_id=e8fb8ef6175c4abcafdf59c6c7882382, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:04.333123 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96656fe9-492c-4c88-ad10-9f0324be9d98 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:04.345485 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1248/2495] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:04 2022] PUT /identity/v3/projects/7990a2e84b3a496ca6151112d0bfbfde/users/e8fb8ef6175c4abcafdf59c6c7882382/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:17:04.350115 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda790b0-3f28-4e4b-95b5-17a8d410b3bc admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:04.359817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda790b0-3f28-4e4b-95b5-17a8d410b3bc admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:04.415468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa724095-e827-4d5d-b7da-d2564665a870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:04.416136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724095-e827-4d5d-b7da-d2564665a870 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:04.416452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724095-e827-4d5d-b7da-d2564665a870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:04.416729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa724095-e827-4d5d-b7da-d2564665a870 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:04.417455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa724095-e827-4d5d-b7da-d2564665a870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:04.419053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa724095-e827-4d5d-b7da-d2564665a870 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:04.429551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1248/2496] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:04.433687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96656fe9-492c-4c88-ad10-9f0324be9d98 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:04.443759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96656fe9-492c-4c88-ad10-9f0324be9d98 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:04.448394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b961b-4fb7-4aa2-9474-be7488a10267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:04.449262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b961b-4fb7-4aa2-9474-be7488a10267 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:04.449549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b961b-4fb7-4aa2-9474-be7488a10267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:04.450069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b961b-4fb7-4aa2-9474-be7488a10267 admin admin] PATH_INFO: `/v3/projects/7990a2e84b3a496ca6151112d0bfbfde/users/e8fb8ef6175c4abcafdf59c6c7882382/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:04.452031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b961b-4fb7-4aa2-9474-be7488a10267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7990a2e84b3a496ca6151112d0bfbfde, user_id=e8fb8ef6175c4abcafdf59c6c7882382, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:04.454693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b961b-4fb7-4aa2-9474-be7488a10267 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:04.465151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1249/2497] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:04 2022] PUT /identity/v3/projects/7990a2e84b3a496ca6151112d0bfbfde/users/e8fb8ef6175c4abcafdf59c6c7882382/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:04.475856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ad3e8-63ec-4eff-b33c-c4b31592d87c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:04.476143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ad3e8-63ec-4eff-b33c-c4b31592d87c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:04.476461 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ad3e8-63ec-4eff-b33c-c4b31592d87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:04.501550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-196ad3e8-63ec-4eff-b33c-c4b31592d87c None None] MFA Rules not processed for user `e8fb8ef6175c4abcafdf59c6c7882382`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:04.502722 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-196ad3e8-63ec-4eff-b33c-c4b31592d87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:04.567717 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1249/2498] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:04.578600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b961b-4fb7-4aa2-9474-be7488a10267 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:04.580430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a08b961b-4fb7-4aa2-9474-be7488a10267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:04.638622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b961b-4fb7-4aa2-9474-be7488a10267 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:04.642285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded69205-cc42-4fc7-ae51-5c7d71f9d0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:04.642973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded69205-cc42-4fc7-ae51-5c7d71f9d0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:04.643260 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded69205-cc42-4fc7-ae51-5c7d71f9d0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:04.643539 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded69205-cc42-4fc7-ae51-5c7d71f9d0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:04.652925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded69205-cc42-4fc7-ae51-5c7d71f9d0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:04.654360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded69205-cc42-4fc7-ae51-5c7d71f9d0d3 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:04.664592 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1250/2499] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:05.954441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ad3e8-63ec-4eff-b33c-c4b31592d87c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:06.022121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ad3e8-63ec-4eff-b33c-c4b31592d87c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:06.027049 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:06.027926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:06.028242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:06.028526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] PATH_INFO: `/v3/users/0dff3397a82c445ab713ae5859cadf41` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:06.030057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dff3397a82c445ab713ae5859cadf41)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:06.032149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:06.086341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dff3397a82c445ab713ae5859cadf41'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.093030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dff3397a82c445ab713ae5859cadf41'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.102240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dff3397a82c445ab713ae5859cadf41'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.102993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dff3397a82c445ab713ae5859cadf41'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.103628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dff3397a82c445ab713ae5859cadf41'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.120373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1250/2500] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:05 2022] DELETE /identity/v3/users/0dff3397a82c445ab713ae5859cadf41 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:06.124831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb94ad-ec3c-4832-aa83-29c2c7d3a7b5 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:06.125307 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb94ad-ec3c-4832-aa83-29c2c7d3a7b5 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:06.125403 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb94ad-ec3c-4832-aa83-29c2c7d3a7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:06.143059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f5fb94ad-ec3c-4832-aa83-29c2c7d3a7b5 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:06.144279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f5fb94ad-ec3c-4832-aa83-29c2c7d3a7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:06.201504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1251/2501] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:06.211691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:06.213093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:06.270367 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51581d-8bf2-4ba2-9f77-5907fcc898fa admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:06.274088 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ec95d-2260-4bc1-ad2d-fdfb9641f340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:06.274737 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ec95d-2260-4bc1-ad2d-fdfb9641f340 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:06.275020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ec95d-2260-4bc1-ad2d-fdfb9641f340 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:06.275290 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ec95d-2260-4bc1-ad2d-fdfb9641f340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:06.285222 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ec95d-2260-4bc1-ad2d-fdfb9641f340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:06.287550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ec95d-2260-4bc1-ad2d-fdfb9641f340 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:06.297462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1251/2502] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:06.574738 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb94ad-ec3c-4832-aa83-29c2c7d3a7b5 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:06.576423 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f5fb94ad-ec3c-4832-aa83-29c2c7d3a7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:06.593531 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb94ad-ec3c-4832-aa83-29c2c7d3a7b5 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:06.598877 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:06.600159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:06.600420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:06.600694 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] PATH_INFO: `/v3/projects/f79fbab2842248d389c125caa44ba358` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:06.602150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79fbab2842248d389c125caa44ba358)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:06.604051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:06.650302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79fbab2842248d389c125caa44ba358', 'request_id': 'req-90a44f64-24d1-4844-8e77-62e7c17733a0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.656534 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79fbab2842248d389c125caa44ba358', 'request_id': 'req-90a44f64-24d1-4844-8e77-62e7c17733a0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.662666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79fbab2842248d389c125caa44ba358', 'request_id': 'req-90a44f64-24d1-4844-8e77-62e7c17733a0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.675011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] The token cache is being invalidate because project f79fbab2842248d389c125caa44ba358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:17:06.675293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.675970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.677871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1252/2503] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:17:06 2022] DELETE /identity/v3/projects/f79fbab2842248d389c125caa44ba358 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:06.682082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ec95d-2260-4bc1-ad2d-fdfb9641f340 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:06.692056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ec95d-2260-4bc1-ad2d-fdfb9641f340 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:06.749404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707d2f9-857a-4005-a5b3-844d68e7a943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:06.750272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d2f9-857a-4005-a5b3-844d68e7a943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:06.750550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d2f9-857a-4005-a5b3-844d68e7a943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:06.750819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707d2f9-857a-4005-a5b3-844d68e7a943 admin admin] PATH_INFO: `/v3/users/e8fb8ef6175c4abcafdf59c6c7882382` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:06.751993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d2f9-857a-4005-a5b3-844d68e7a943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8fb8ef6175c4abcafdf59c6c7882382)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:06.753938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707d2f9-857a-4005-a5b3-844d68e7a943 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:06.800738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5707d2f9-857a-4005-a5b3-844d68e7a943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8fb8ef6175c4abcafdf59c6c7882382'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.810793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5707d2f9-857a-4005-a5b3-844d68e7a943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8fb8ef6175c4abcafdf59c6c7882382'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.823990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5707d2f9-857a-4005-a5b3-844d68e7a943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8fb8ef6175c4abcafdf59c6c7882382'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.824622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5707d2f9-857a-4005-a5b3-844d68e7a943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8fb8ef6175c4abcafdf59c6c7882382'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.825483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5707d2f9-857a-4005-a5b3-844d68e7a943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8fb8ef6175c4abcafdf59c6c7882382'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:06.842374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1252/2504] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:06 2022] DELETE /identity/v3/users/e8fb8ef6175c4abcafdf59c6c7882382 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:07.102703 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:07.104315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:07.119457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a44f64-24d1-4844-8e77-62e7c17733a0 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:07.176416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:07.177333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.177642 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.177890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] PATH_INFO: `/v3/projects/7990a2e84b3a496ca6151112d0bfbfde` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.179165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7990a2e84b3a496ca6151112d0bfbfde)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:07.181114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:07.229979 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7990a2e84b3a496ca6151112d0bfbfde', 'request_id': 'req-1bfdc82a-66ae-40ab-b190-1237ef0386d4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:07.236562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7990a2e84b3a496ca6151112d0bfbfde', 'request_id': 'req-1bfdc82a-66ae-40ab-b190-1237ef0386d4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:07.242841 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7990a2e84b3a496ca6151112d0bfbfde', 'request_id': 'req-1bfdc82a-66ae-40ab-b190-1237ef0386d4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:07.255556 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] The token cache is being invalidate because project 7990a2e84b3a496ca6151112d0bfbfde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:17:07.255842 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:07.256496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-1bfdc82a-66ae-40ab-b190-1237ef0386d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:07.258193 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1253/2505] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:17:07 2022] DELETE /identity/v3/projects/7990a2e84b3a496ca6151112d0bfbfde => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:07.263285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf55195-cabb-4f44-bd2a-d4cff9b2e09b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.263777 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf55195-cabb-4f44-bd2a-d4cff9b2e09b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.263882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf55195-cabb-4f44-bd2a-d4cff9b2e09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.281815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-6bf55195-cabb-4f44-bd2a-d4cff9b2e09b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:07.282989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6bf55195-cabb-4f44-bd2a-d4cff9b2e09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:07.344241 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1253/2506] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:07.353358 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63927e3c-b3bf-4ee9-b42e-c1cbb4e57cba None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.353681 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63927e3c-b3bf-4ee9-b42e-c1cbb4e57cba None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.353996 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63927e3c-b3bf-4ee9-b42e-c1cbb4e57cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.373956 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-63927e3c-b3bf-4ee9-b42e-c1cbb4e57cba None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:07.375616 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-63927e3c-b3bf-4ee9-b42e-c1cbb4e57cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:07.386318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1254/2507] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:07.390915 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf55195-cabb-4f44-bd2a-d4cff9b2e09b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:07.402139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf55195-cabb-4f44-bd2a-d4cff9b2e09b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:07.406951 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc99714-ebbf-45ef-8779-eca64f372ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:07.407673 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99714-ebbf-45ef-8779-eca64f372ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.407956 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99714-ebbf-45ef-8779-eca64f372ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.408257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99714-ebbf-45ef-8779-eca64f372ad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.409008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc99714-ebbf-45ef-8779-eca64f372ad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:17:07.409329 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc99714-ebbf-45ef-8779-eca64f372ad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:07.410992 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc99714-ebbf-45ef-8779-eca64f372ad7 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:07.426087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1254/2508] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:17:07.427180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63927e3c-b3bf-4ee9-b42e-c1cbb4e57cba None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:07.436661 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63927e3c-b3bf-4ee9-b42e-c1cbb4e57cba None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:07.441212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e347b-19bb-4512-85ac-fc91b60b30f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:07.442553 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e347b-19bb-4512-85ac-fc91b60b30f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.442851 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e347b-19bb-4512-85ac-fc91b60b30f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.443133 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e347b-19bb-4512-85ac-fc91b60b30f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.443861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e347b-19bb-4512-85ac-fc91b60b30f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:07.445850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e347b-19bb-4512-85ac-fc91b60b30f8 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:07.472068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1255/2509] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:17:07 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:17:07.476481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc99714-ebbf-45ef-8779-eca64f372ad7 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:07.486250 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc99714-ebbf-45ef-8779-eca64f372ad7 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:07.542340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfe509-be1a-40cb-ade2-b42d7ab90a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:07.543012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe509-be1a-40cb-ade2-b42d7ab90a68 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.543371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe509-be1a-40cb-ade2-b42d7ab90a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.543581 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe509-be1a-40cb-ade2-b42d7ab90a68 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.544305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfe509-be1a-40cb-ade2-b42d7ab90a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:07.546221 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfe509-be1a-40cb-ade2-b42d7ab90a68 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:07.567960 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1255/2510] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:17:07 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:17:07.572274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e347b-19bb-4512-85ac-fc91b60b30f8 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:07.582924 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e347b-19bb-4512-85ac-fc91b60b30f8 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:07.587800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ae99c-7e66-4ade-b655-b5e6ee1c7038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:07.588535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ae99c-7e66-4ade-b655-b5e6ee1c7038 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.588850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ae99c-7e66-4ade-b655-b5e6ee1c7038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.589157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ae99c-7e66-4ade-b655-b5e6ee1c7038 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.589988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ae99c-7e66-4ade-b655-b5e6ee1c7038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:07.591670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ae99c-7e66-4ade-b655-b5e6ee1c7038 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:07.603080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1256/2511] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:07.607141 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfe509-be1a-40cb-ade2-b42d7ab90a68 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:07.617588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfe509-be1a-40cb-ade2-b42d7ab90a68 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:07.622171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3d7a7-1b07-49cb-876d-54f3df2b9d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:07.622818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d7a7-1b07-49cb-876d-54f3df2b9d49 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.623105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d7a7-1b07-49cb-876d-54f3df2b9d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.623384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d7a7-1b07-49cb-876d-54f3df2b9d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.624132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3d7a7-1b07-49cb-876d-54f3df2b9d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:07.625757 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3d7a7-1b07-49cb-876d-54f3df2b9d49 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:07.636762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1256/2512] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:07.640950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ae99c-7e66-4ade-b655-b5e6ee1c7038 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:07.650960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ae99c-7e66-4ade-b655-b5e6ee1c7038 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:07.655550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75be71-6e9e-432b-881a-610da894c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:07.656493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75be71-6e9e-432b-881a-610da894c95c admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.656775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75be71-6e9e-432b-881a-610da894c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.657046 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75be71-6e9e-432b-881a-610da894c95c admin admin] PATH_INFO: `/v3/projects/585d960dd02943e3bc9760dd5045e12d/users/68fca1ccba564b339df2b531bd84da9a/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.670960 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75be71-6e9e-432b-881a-610da894c95c admin admin] RBAC: Authorizing `identity:create_grant(project_id=585d960dd02943e3bc9760dd5045e12d, user_id=68fca1ccba564b339df2b531bd84da9a, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:07.673610 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75be71-6e9e-432b-881a-610da894c95c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:07.686824 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1257/2513] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:07 2022] PUT /identity/v3/projects/585d960dd02943e3bc9760dd5045e12d/users/68fca1ccba564b339df2b531bd84da9a/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:07.697654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138de793-ae42-4170-afea-3815357338f4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.698018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138de793-ae42-4170-afea-3815357338f4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.698295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138de793-ae42-4170-afea-3815357338f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.723974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-138de793-ae42-4170-afea-3815357338f4 None None] MFA Rules not processed for user `68fca1ccba564b339df2b531bd84da9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:07.725188 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-138de793-ae42-4170-afea-3815357338f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:07.789518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1257/2514] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:07.793807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75be71-6e9e-432b-881a-610da894c95c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:07.853621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75be71-6e9e-432b-881a-610da894c95c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:07.858256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038ba4d-cf1d-49d2-847e-a2e36e0bb8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:07.858913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ba4d-cf1d-49d2-847e-a2e36e0bb8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.859195 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ba4d-cf1d-49d2-847e-a2e36e0bb8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.859470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ba4d-cf1d-49d2-847e-a2e36e0bb8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.860149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038ba4d-cf1d-49d2-847e-a2e36e0bb8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:07.862065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038ba4d-cf1d-49d2-847e-a2e36e0bb8c4 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:07.890377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1258/2515] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:17:07 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:17:07.891511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138de793-ae42-4170-afea-3815357338f4 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:07.902056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138de793-ae42-4170-afea-3815357338f4 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:07.962271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95154bb6-0b91-478d-b710-20f388b33e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:07.962947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95154bb6-0b91-478d-b710-20f388b33e1c admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:07.963213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95154bb6-0b91-478d-b710-20f388b33e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:07.963484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95154bb6-0b91-478d-b710-20f388b33e1c admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:07.964173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95154bb6-0b91-478d-b710-20f388b33e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:07.966104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95154bb6-0b91-478d-b710-20f388b33e1c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:07.985611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1258/2516] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:17:07 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:17:07.990180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038ba4d-cf1d-49d2-847e-a2e36e0bb8c4 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:08.003850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038ba4d-cf1d-49d2-847e-a2e36e0bb8c4 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:08.008701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db4419-7ca3-4034-b942-7f4ee3cfb427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:08.009490 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db4419-7ca3-4034-b942-7f4ee3cfb427 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:08.009832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db4419-7ca3-4034-b942-7f4ee3cfb427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:08.010274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db4419-7ca3-4034-b942-7f4ee3cfb427 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:08.011068 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db4419-7ca3-4034-b942-7f4ee3cfb427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:08.013034 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db4419-7ca3-4034-b942-7f4ee3cfb427 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:08.023857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1259/2517] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:08.028047 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95154bb6-0b91-478d-b710-20f388b33e1c admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:08.038270 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95154bb6-0b91-478d-b710-20f388b33e1c admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:08.042838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67522191-6402-45bf-8f6b-cd371fde526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:08.043637 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67522191-6402-45bf-8f6b-cd371fde526c admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:08.043914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67522191-6402-45bf-8f6b-cd371fde526c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:08.044197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67522191-6402-45bf-8f6b-cd371fde526c admin admin] PATH_INFO: `/v3/projects/7405093e818e462496af72f5fcc93941/users/a5389e05299a4becb7611e5e7275ccc4/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:08.059328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67522191-6402-45bf-8f6b-cd371fde526c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7405093e818e462496af72f5fcc93941, user_id=a5389e05299a4becb7611e5e7275ccc4, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:08.062139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67522191-6402-45bf-8f6b-cd371fde526c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:08.076197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1259/2518] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:08 2022] PUT /identity/v3/projects/7405093e818e462496af72f5fcc93941/users/a5389e05299a4becb7611e5e7275ccc4/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:08.080074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db4419-7ca3-4034-b942-7f4ee3cfb427 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:08.089967 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db4419-7ca3-4034-b942-7f4ee3cfb427 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:08.143699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde4fef-f0a3-408d-b081-f096c47e1f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:08.144381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde4fef-f0a3-408d-b081-f096c47e1f41 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:08.145044 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde4fef-f0a3-408d-b081-f096c47e1f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:08.145422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde4fef-f0a3-408d-b081-f096c47e1f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:08.146139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde4fef-f0a3-408d-b081-f096c47e1f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:08.147733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde4fef-f0a3-408d-b081-f096c47e1f41 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:08.157591 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1260/2519] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:17:08.162154 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67522191-6402-45bf-8f6b-cd371fde526c admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:08.172658 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67522191-6402-45bf-8f6b-cd371fde526c admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:08.177942 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41e860-2ec9-4eb8-bce9-a8aaaf955bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:08.178807 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e860-2ec9-4eb8-bce9-a8aaaf955bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:08.179090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e860-2ec9-4eb8-bce9-a8aaaf955bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:08.179366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41e860-2ec9-4eb8-bce9-a8aaaf955bc2 admin admin] PATH_INFO: `/v3/projects/7405093e818e462496af72f5fcc93941/users/a5389e05299a4becb7611e5e7275ccc4/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:08.181339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41e860-2ec9-4eb8-bce9-a8aaaf955bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7405093e818e462496af72f5fcc93941, user_id=a5389e05299a4becb7611e5e7275ccc4, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:08.183953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41e860-2ec9-4eb8-bce9-a8aaaf955bc2 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:08.193968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1260/2520] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:08 2022] PUT /identity/v3/projects/7405093e818e462496af72f5fcc93941/users/a5389e05299a4becb7611e5e7275ccc4/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:17:08.204125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd55157-249c-4da8-a982-a16c8db38f18 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:08.204627 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd55157-249c-4da8-a982-a16c8db38f18 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:08.204733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd55157-249c-4da8-a982-a16c8db38f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:08.231319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2dd55157-249c-4da8-a982-a16c8db38f18 None None] MFA Rules not processed for user `a5389e05299a4becb7611e5e7275ccc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:08.232533 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2dd55157-249c-4da8-a982-a16c8db38f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:08.297578 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1261/2521] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:17:08.308339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41e860-2ec9-4eb8-bce9-a8aaaf955bc2 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:08.310089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ec41e860-2ec9-4eb8-bce9-a8aaaf955bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:08.365114 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41e860-2ec9-4eb8-bce9-a8aaaf955bc2 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:08.368747 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57774dbc-b4d8-4fa9-a9de-f22715495d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:08.369376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57774dbc-b4d8-4fa9-a9de-f22715495d75 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:08.369656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57774dbc-b4d8-4fa9-a9de-f22715495d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:08.369932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57774dbc-b4d8-4fa9-a9de-f22715495d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:08.378721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57774dbc-b4d8-4fa9-a9de-f22715495d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:08.380164 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57774dbc-b4d8-4fa9-a9de-f22715495d75 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:08.389327 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1261/2522] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:08.780516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd55157-249c-4da8-a982-a16c8db38f18 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:08.841141 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd55157-249c-4da8-a982-a16c8db38f18 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:08.845547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:08.846403 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:08.846686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:08.846962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] PATH_INFO: `/v3/users/68fca1ccba564b339df2b531bd84da9a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:08.848159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fca1ccba564b339df2b531bd84da9a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:08.850099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:08.893205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fca1ccba564b339df2b531bd84da9a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:08.893838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fca1ccba564b339df2b531bd84da9a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:08.900983 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fca1ccba564b339df2b531bd84da9a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:08.907936 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fca1ccba564b339df2b531bd84da9a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:08.908603 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fca1ccba564b339df2b531bd84da9a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:08.924807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1262/2523] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:08 2022] DELETE /identity/v3/users/68fca1ccba564b339df2b531bd84da9a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:08.929268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bc790-13ec-4599-892c-e005a5e1b036 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:08.929559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bc790-13ec-4599-892c-e005a5e1b036 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:08.929836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bc790-13ec-4599-892c-e005a5e1b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:08.949775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-543bc790-13ec-4599-892c-e005a5e1b036 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:08.951215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-543bc790-13ec-4599-892c-e005a5e1b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:09.007928 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1262/2524] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:09.017501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:09.018924 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:09.075916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d989491-986b-4c27-bde6-018249f697ef admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:09.079741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8644861-d33a-440f-b8d1-331e1418ce7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:09.080446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644861-d33a-440f-b8d1-331e1418ce7f service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:09.080732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644861-d33a-440f-b8d1-331e1418ce7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:09.081007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8644861-d33a-440f-b8d1-331e1418ce7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:09.090906 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8644861-d33a-440f-b8d1-331e1418ce7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:09.092432 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8644861-d33a-440f-b8d1-331e1418ce7f service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:09.102185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1263/2525] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:09.363566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bc790-13ec-4599-892c-e005a5e1b036 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:09.365311 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-543bc790-13ec-4599-892c-e005a5e1b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:09.377263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bc790-13ec-4599-892c-e005a5e1b036 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:09.382951 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:09.383862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:09.384238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:09.384913 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] PATH_INFO: `/v3/projects/585d960dd02943e3bc9760dd5045e12d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:09.386180 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=585d960dd02943e3bc9760dd5045e12d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:09.388489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:09.435029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585d960dd02943e3bc9760dd5045e12d', 'request_id': 'req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:09.443069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585d960dd02943e3bc9760dd5045e12d', 'request_id': 'req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:09.449269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585d960dd02943e3bc9760dd5045e12d', 'request_id': 'req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:09.461511 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] The token cache is being invalidate because project 585d960dd02943e3bc9760dd5045e12d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:17:09.461797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:09.463218 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:09.464922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1263/2526] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:17:09 2022] DELETE /identity/v3/projects/585d960dd02943e3bc9760dd5045e12d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:09.469031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8644861-d33a-440f-b8d1-331e1418ce7f service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:09.478949 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8644861-d33a-440f-b8d1-331e1418ce7f service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:09.538200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81d04e-d271-4c69-9db1-579e1c4cd86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:09.539082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d04e-d271-4c69-9db1-579e1c4cd86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:09.539370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d04e-d271-4c69-9db1-579e1c4cd86c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:09.539650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d04e-d271-4c69-9db1-579e1c4cd86c admin admin] PATH_INFO: `/v3/users/a5389e05299a4becb7611e5e7275ccc4` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:09.540890 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81d04e-d271-4c69-9db1-579e1c4cd86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5389e05299a4becb7611e5e7275ccc4)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:09.542806 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81d04e-d271-4c69-9db1-579e1c4cd86c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:09.590899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c81d04e-d271-4c69-9db1-579e1c4cd86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5389e05299a4becb7611e5e7275ccc4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:09.591560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c81d04e-d271-4c69-9db1-579e1c4cd86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5389e05299a4becb7611e5e7275ccc4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:09.598259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c81d04e-d271-4c69-9db1-579e1c4cd86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5389e05299a4becb7611e5e7275ccc4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:09.605414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c81d04e-d271-4c69-9db1-579e1c4cd86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5389e05299a4becb7611e5e7275ccc4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:09.606037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4c81d04e-d271-4c69-9db1-579e1c4cd86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5389e05299a4becb7611e5e7275ccc4'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:09.622937 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1264/2527] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:09 2022] DELETE /identity/v3/users/a5389e05299a4becb7611e5e7275ccc4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:09.888372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:09.889894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:09.903150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e4dd8-6eb1-4a30-bf48-15f520d54f6c admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:09.958699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:09.959554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:09.959835 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:09.960111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] PATH_INFO: `/v3/projects/7405093e818e462496af72f5fcc93941` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:09.961361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7405093e818e462496af72f5fcc93941)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:09.963305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.008649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7405093e818e462496af72f5fcc93941', 'request_id': 'req-e269e905-dbf9-4066-aa96-f8c75dd7068a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:10.015601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7405093e818e462496af72f5fcc93941', 'request_id': 'req-e269e905-dbf9-4066-aa96-f8c75dd7068a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:10.021867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7405093e818e462496af72f5fcc93941', 'request_id': 'req-e269e905-dbf9-4066-aa96-f8c75dd7068a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:10.031535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] The token cache is being invalidate because project 7405093e818e462496af72f5fcc93941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:17:10.031819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:10.032474 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-e269e905-dbf9-4066-aa96-f8c75dd7068a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:10.033988 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1264/2528] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:17:09 2022] DELETE /identity/v3/projects/7405093e818e462496af72f5fcc93941 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:10.039249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb3ff-c05c-4a90-aed1-6dd2533fcaa1 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.039567 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb3ff-c05c-4a90-aed1-6dd2533fcaa1 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.039873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb3ff-c05c-4a90-aed1-6dd2533fcaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.059180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-e75cb3ff-c05c-4a90-aed1-6dd2533fcaa1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:10.060399 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e75cb3ff-c05c-4a90-aed1-6dd2533fcaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:10.121059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1265/2529] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:10.128779 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdc35-c8a1-4282-8e92-3c9d2e650e6c None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.129114 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdc35-c8a1-4282-8e92-3c9d2e650e6c None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.129392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdc35-c8a1-4282-8e92-3c9d2e650e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.147026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-0ffbdc35-c8a1-4282-8e92-3c9d2e650e6c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:10.148233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0ffbdc35-c8a1-4282-8e92-3c9d2e650e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:10.155982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1265/2530] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:10.160712 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cb3ff-c05c-4a90-aed1-6dd2533fcaa1 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:10.177105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cb3ff-c05c-4a90-aed1-6dd2533fcaa1 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:10.181776 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8802205-31be-4c1f-b31f-b6ff746f0596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:10.182432 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8802205-31be-4c1f-b31f-b6ff746f0596 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.182723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8802205-31be-4c1f-b31f-b6ff746f0596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.183002 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8802205-31be-4c1f-b31f-b6ff746f0596 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.183733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8802205-31be-4c1f-b31f-b6ff746f0596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:17:10.184045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8802205-31be-4c1f-b31f-b6ff746f0596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:10.185674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8802205-31be-4c1f-b31f-b6ff746f0596 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.197639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1266/2531] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:17:10.202444 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbdc35-c8a1-4282-8e92-3c9d2e650e6c None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:10.211671 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbdc35-c8a1-4282-8e92-3c9d2e650e6c None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:10.216415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e44a-d3a1-4775-aae1-ff2dfcc80c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:10.217067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e44a-d3a1-4775-aae1-ff2dfcc80c65 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.217354 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e44a-d3a1-4775-aae1-ff2dfcc80c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.217636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217e44a-d3a1-4775-aae1-ff2dfcc80c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.218337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217e44a-d3a1-4775-aae1-ff2dfcc80c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:10.220287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217e44a-d3a1-4775-aae1-ff2dfcc80c65 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.250618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1266/2532] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:17:10 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:17:10.251760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8802205-31be-4c1f-b31f-b6ff746f0596 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:10.261985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8802205-31be-4c1f-b31f-b6ff746f0596 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:10.325334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0960c1-c792-4d8d-ba9a-766b8e49b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:10.326000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0960c1-c792-4d8d-ba9a-766b8e49b38c admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.326289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0960c1-c792-4d8d-ba9a-766b8e49b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.326558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0960c1-c792-4d8d-ba9a-766b8e49b38c admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.327243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0960c1-c792-4d8d-ba9a-766b8e49b38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:10.329341 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0960c1-c792-4d8d-ba9a-766b8e49b38c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.349529 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1267/2533] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:17:10 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:17:10.353524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e44a-d3a1-4775-aae1-ff2dfcc80c65 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:10.364592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217e44a-d3a1-4775-aae1-ff2dfcc80c65 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:10.369833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f7c00-ce21-48f8-b9b8-62594e0c85d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:10.370492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f7c00-ce21-48f8-b9b8-62594e0c85d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.370775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f7c00-ce21-48f8-b9b8-62594e0c85d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.371046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f7c00-ce21-48f8-b9b8-62594e0c85d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.371770 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f7c00-ce21-48f8-b9b8-62594e0c85d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:10.373389 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f7c00-ce21-48f8-b9b8-62594e0c85d1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.387352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1267/2534] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:10.388581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0960c1-c792-4d8d-ba9a-766b8e49b38c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:10.399138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0960c1-c792-4d8d-ba9a-766b8e49b38c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:10.404204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d30538-0d95-4f6a-b0cc-f0f32880c002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:10.405006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30538-0d95-4f6a-b0cc-f0f32880c002 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.405289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30538-0d95-4f6a-b0cc-f0f32880c002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.405591 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30538-0d95-4f6a-b0cc-f0f32880c002 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.406305 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d30538-0d95-4f6a-b0cc-f0f32880c002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:10.407884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d30538-0d95-4f6a-b0cc-f0f32880c002 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.417628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1268/2535] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:10.421721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f7c00-ce21-48f8-b9b8-62594e0c85d1 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:10.431466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f7c00-ce21-48f8-b9b8-62594e0c85d1 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:10.435982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2f577-df86-414c-871f-3874f2457177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:10.436954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2f577-df86-414c-871f-3874f2457177 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.437234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2f577-df86-414c-871f-3874f2457177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.437505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2f577-df86-414c-871f-3874f2457177 admin admin] PATH_INFO: `/v3/projects/830ac0a98b3145b79670f1d5f13e1da4/users/e4456dbb437746f19769bbecfbbb5cea/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.452233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2f577-df86-414c-871f-3874f2457177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=830ac0a98b3145b79670f1d5f13e1da4, user_id=e4456dbb437746f19769bbecfbbb5cea, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:10.454865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2f577-df86-414c-871f-3874f2457177 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.468051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1268/2536] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:10 2022] PUT /identity/v3/projects/830ac0a98b3145b79670f1d5f13e1da4/users/e4456dbb437746f19769bbecfbbb5cea/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:10.478643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeca875-0812-4a4a-98d1-d0d6e4b2efaa None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.479104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeca875-0812-4a4a-98d1-d0d6e4b2efaa None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.479213 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeca875-0812-4a4a-98d1-d0d6e4b2efaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.506169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-4aeca875-0812-4a4a-98d1-d0d6e4b2efaa None None] MFA Rules not processed for user `e4456dbb437746f19769bbecfbbb5cea`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:10.507340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4aeca875-0812-4a4a-98d1-d0d6e4b2efaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:10.569438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1269/2537] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:10.573902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2f577-df86-414c-871f-3874f2457177 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:10.636133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2f577-df86-414c-871f-3874f2457177 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:10.640764 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d677da3-e680-4e8f-86e5-3ee4c9c085d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:10.641410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d677da3-e680-4e8f-86e5-3ee4c9c085d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.641691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d677da3-e680-4e8f-86e5-3ee4c9c085d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.641965 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d677da3-e680-4e8f-86e5-3ee4c9c085d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.642650 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d677da3-e680-4e8f-86e5-3ee4c9c085d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:10.644595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d677da3-e680-4e8f-86e5-3ee4c9c085d7 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.668710 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1269/2538] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:17:10 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:17:10.672646 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeca875-0812-4a4a-98d1-d0d6e4b2efaa None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:10.683698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeca875-0812-4a4a-98d1-d0d6e4b2efaa None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:10.737297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740c078-7514-4541-93e6-b2cfdf27ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:10.737955 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740c078-7514-4541-93e6-b2cfdf27ed8a admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.738238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740c078-7514-4541-93e6-b2cfdf27ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.739207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740c078-7514-4541-93e6-b2cfdf27ed8a admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.739919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740c078-7514-4541-93e6-b2cfdf27ed8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:10.741861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740c078-7514-4541-93e6-b2cfdf27ed8a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.761274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1270/2539] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:17:10 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:17:10.765199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d677da3-e680-4e8f-86e5-3ee4c9c085d7 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:10.775695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d677da3-e680-4e8f-86e5-3ee4c9c085d7 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:10.780225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9ce84-5274-4fd9-9454-79e7f0480e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:10.780871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9ce84-5274-4fd9-9454-79e7f0480e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.781149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9ce84-5274-4fd9-9454-79e7f0480e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.781419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9ce84-5274-4fd9-9454-79e7f0480e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.782135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9ce84-5274-4fd9-9454-79e7f0480e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:10.783704 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9ce84-5274-4fd9-9454-79e7f0480e35 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.794472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1270/2540] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:10.798300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740c078-7514-4541-93e6-b2cfdf27ed8a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:10.808121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740c078-7514-4541-93e6-b2cfdf27ed8a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:10.812710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de345778-84b9-4f0b-9cfc-767ecc2584ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:10.813358 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345778-84b9-4f0b-9cfc-767ecc2584ac admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.813643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345778-84b9-4f0b-9cfc-767ecc2584ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.813918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345778-84b9-4f0b-9cfc-767ecc2584ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.814633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de345778-84b9-4f0b-9cfc-767ecc2584ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:10.816246 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de345778-84b9-4f0b-9cfc-767ecc2584ac admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.826180 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1271/2541] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:10.830009 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9ce84-5274-4fd9-9454-79e7f0480e35 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:10.839993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9ce84-5274-4fd9-9454-79e7f0480e35 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:10.844800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14765d70-7e4e-4b90-a086-3ba43acaf551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:10.845662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14765d70-7e4e-4b90-a086-3ba43acaf551 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.845943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14765d70-7e4e-4b90-a086-3ba43acaf551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.846215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14765d70-7e4e-4b90-a086-3ba43acaf551 admin admin] PATH_INFO: `/v3/projects/b6b62aa8883f4dc1911fb3b8bae55f2c/users/f3ce5b76ea6f4db9b3753e622487a721/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.861072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14765d70-7e4e-4b90-a086-3ba43acaf551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b62aa8883f4dc1911fb3b8bae55f2c, user_id=f3ce5b76ea6f4db9b3753e622487a721, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:10.863715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14765d70-7e4e-4b90-a086-3ba43acaf551 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:10.877059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1271/2542] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:10 2022] PUT /identity/v3/projects/b6b62aa8883f4dc1911fb3b8bae55f2c/users/f3ce5b76ea6f4db9b3753e622487a721/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:10.888785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60af92-9c19-41f4-9e16-6572330b2800 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:10.889075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60af92-9c19-41f4-9e16-6572330b2800 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:10.889352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60af92-9c19-41f4-9e16-6572330b2800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:10.915564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1f60af92-9c19-41f4-9e16-6572330b2800 None None] MFA Rules not processed for user `f3ce5b76ea6f4db9b3753e622487a721`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:10.916780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1f60af92-9c19-41f4-9e16-6572330b2800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:10.978303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1272/2543] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:10.982735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14765d70-7e4e-4b90-a086-3ba43acaf551 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:11.043587 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14765d70-7e4e-4b90-a086-3ba43acaf551 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:11.048325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f333c-5f69-4cc4-8c45-e84d510b9bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:11.048981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f333c-5f69-4cc4-8c45-e84d510b9bda admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:11.049266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f333c-5f69-4cc4-8c45-e84d510b9bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:11.049547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f333c-5f69-4cc4-8c45-e84d510b9bda admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:11.050242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f333c-5f69-4cc4-8c45-e84d510b9bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:11.052171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f333c-5f69-4cc4-8c45-e84d510b9bda admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:11.076944 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1272/2544] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:17:10 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:17:11.081177 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60af92-9c19-41f4-9e16-6572330b2800 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:11.092204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60af92-9c19-41f4-9e16-6572330b2800 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:11.145991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b420ef-04e9-44ab-85e3-6d44763916f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:11.146649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b420ef-04e9-44ab-85e3-6d44763916f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:11.146934 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b420ef-04e9-44ab-85e3-6d44763916f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:11.147214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b420ef-04e9-44ab-85e3-6d44763916f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:11.147901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b420ef-04e9-44ab-85e3-6d44763916f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:11.149859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b420ef-04e9-44ab-85e3-6d44763916f2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:11.168935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1273/2545] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:17:11 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:17:11.173063 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f333c-5f69-4cc4-8c45-e84d510b9bda admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:11.183403 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f333c-5f69-4cc4-8c45-e84d510b9bda admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:11.187922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a401bf-120e-46ce-b65e-565e988c3138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:11.188595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a401bf-120e-46ce-b65e-565e988c3138 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:11.188896 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a401bf-120e-46ce-b65e-565e988c3138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:11.189153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a401bf-120e-46ce-b65e-565e988c3138 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:11.189875 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a401bf-120e-46ce-b65e-565e988c3138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:11.192012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a401bf-120e-46ce-b65e-565e988c3138 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:11.202605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1273/2546] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:11.206502 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b420ef-04e9-44ab-85e3-6d44763916f2 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:11.216891 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b420ef-04e9-44ab-85e3-6d44763916f2 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:11.221535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e075a-c992-404c-8ac8-daf4e65328b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:11.222397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e075a-c992-404c-8ac8-daf4e65328b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:11.222745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e075a-c992-404c-8ac8-daf4e65328b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:11.223135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e075a-c992-404c-8ac8-daf4e65328b2 admin admin] PATH_INFO: `/v3/projects/7ac7f059587041f79f25e78be71ee735/users/b224e4004ad2434185ed8f6766bc0502/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:11.237232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e075a-c992-404c-8ac8-daf4e65328b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac7f059587041f79f25e78be71ee735, user_id=b224e4004ad2434185ed8f6766bc0502, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:11.240359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e075a-c992-404c-8ac8-daf4e65328b2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:11.252448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1274/2547] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:11 2022] PUT /identity/v3/projects/7ac7f059587041f79f25e78be71ee735/users/b224e4004ad2434185ed8f6766bc0502/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:11.256881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a401bf-120e-46ce-b65e-565e988c3138 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:11.266733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a401bf-120e-46ce-b65e-565e988c3138 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:11.320882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63443bdb-a046-4800-9799-ca3476b88061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:11.321531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443bdb-a046-4800-9799-ca3476b88061 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:11.321809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443bdb-a046-4800-9799-ca3476b88061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:11.322081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63443bdb-a046-4800-9799-ca3476b88061 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:11.322793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63443bdb-a046-4800-9799-ca3476b88061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:11.324391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63443bdb-a046-4800-9799-ca3476b88061 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:11.334336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1274/2548] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:17:11.338450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e075a-c992-404c-8ac8-daf4e65328b2 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:11.348447 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e075a-c992-404c-8ac8-daf4e65328b2 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:11.353019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4aa6-bf23-4a37-a8b8-ac6af6d6303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:11.353891 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4aa6-bf23-4a37-a8b8-ac6af6d6303c admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:11.354173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4aa6-bf23-4a37-a8b8-ac6af6d6303c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:11.354449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4aa6-bf23-4a37-a8b8-ac6af6d6303c admin admin] PATH_INFO: `/v3/projects/7ac7f059587041f79f25e78be71ee735/users/b224e4004ad2434185ed8f6766bc0502/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:11.356415 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f4aa6-bf23-4a37-a8b8-ac6af6d6303c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac7f059587041f79f25e78be71ee735, user_id=b224e4004ad2434185ed8f6766bc0502, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:11.359055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f4aa6-bf23-4a37-a8b8-ac6af6d6303c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:11.369410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1275/2549] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:11 2022] PUT /identity/v3/projects/7ac7f059587041f79f25e78be71ee735/users/b224e4004ad2434185ed8f6766bc0502/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:11.380067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e51ee-a7fc-4f04-9fb6-61f43cef46f8 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:11.380688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e51ee-a7fc-4f04-9fb6-61f43cef46f8 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:11.380688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e51ee-a7fc-4f04-9fb6-61f43cef46f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:11.407799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4c5e51ee-a7fc-4f04-9fb6-61f43cef46f8 None None] MFA Rules not processed for user `b224e4004ad2434185ed8f6766bc0502`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:11.409045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4c5e51ee-a7fc-4f04-9fb6-61f43cef46f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:11.476539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1275/2550] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:11.488008 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4aa6-bf23-4a37-a8b8-ac6af6d6303c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:11.490450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-348f4aa6-bf23-4a37-a8b8-ac6af6d6303c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:11.551333 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4aa6-bf23-4a37-a8b8-ac6af6d6303c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:11.555044 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770f524-2ae4-4db2-a34b-286f36919ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:11.555689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770f524-2ae4-4db2-a34b-286f36919ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:11.556035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770f524-2ae4-4db2-a34b-286f36919ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:11.556353 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770f524-2ae4-4db2-a34b-286f36919ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:11.613270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770f524-2ae4-4db2-a34b-286f36919ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:11.615507 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770f524-2ae4-4db2-a34b-286f36919ea1 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:11.624493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1276/2551] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:13.083181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e51ee-a7fc-4f04-9fb6-61f43cef46f8 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:13.092685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e51ee-a7fc-4f04-9fb6-61f43cef46f8 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:13.096312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51412efa-5279-4a33-924f-bc6d4423d18c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:13.096953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51412efa-5279-4a33-924f-bc6d4423d18c service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:13.097237 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51412efa-5279-4a33-924f-bc6d4423d18c service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:13.097515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51412efa-5279-4a33-924f-bc6d4423d18c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:13.153525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51412efa-5279-4a33-924f-bc6d4423d18c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:13.154873 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51412efa-5279-4a33-924f-bc6d4423d18c service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:13.163770 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1276/2552] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:13.669406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770f524-2ae4-4db2-a34b-286f36919ea1 service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:13.678238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770f524-2ae4-4db2-a34b-286f36919ea1 service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:13.681838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c2492-b2c2-4c21-b728-c9c953fdd24d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:13.682415 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c2492-b2c2-4c21-b728-c9c953fdd24d service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:13.682699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c2492-b2c2-4c21-b728-c9c953fdd24d service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:13.682976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c2492-b2c2-4c21-b728-c9c953fdd24d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:13.692265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c2492-b2c2-4c21-b728-c9c953fdd24d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:13.693652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c2492-b2c2-4c21-b728-c9c953fdd24d service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:13.703508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1277/2553] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:17.538284 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51412efa-5279-4a33-924f-bc6d4423d18c service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:17.600950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51412efa-5279-4a33-924f-bc6d4423d18c service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:17.606325 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:17.607199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:17.607481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:17.607761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] PATH_INFO: `/v3/users/e4456dbb437746f19769bbecfbbb5cea` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:17.608996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4456dbb437746f19769bbecfbbb5cea)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:17.610957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:17.654460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4456dbb437746f19769bbecfbbb5cea'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:17.661615 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4456dbb437746f19769bbecfbbb5cea'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:17.668638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4456dbb437746f19769bbecfbbb5cea'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:17.669301 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4456dbb437746f19769bbecfbbb5cea'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:17.669898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4456dbb437746f19769bbecfbbb5cea'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:17.687348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1277/2554] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:17 2022] DELETE /identity/v3/users/e4456dbb437746f19769bbecfbbb5cea => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:17.691944 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8ef0f-6601-4620-a28e-331a76f854e9 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:17.692477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8ef0f-6601-4620-a28e-331a76f854e9 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:17.692583 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8ef0f-6601-4620-a28e-331a76f854e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:17.710733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-61b8ef0f-6601-4620-a28e-331a76f854e9 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:17.711902 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-61b8ef0f-6601-4620-a28e-331a76f854e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:17.767899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1278/2555] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:17.777839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:17.779209 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:17.840939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4564d37-4776-4740-9caa-caf16f96fdcc admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:17.844456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3a9b8-7463-48d3-af95-db484b003bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:17.845093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3a9b8-7463-48d3-af95-db484b003bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:17.845371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3a9b8-7463-48d3-af95-db484b003bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:17.845643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3a9b8-7463-48d3-af95-db484b003bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:17.854841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3a9b8-7463-48d3-af95-db484b003bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:17.856292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3a9b8-7463-48d3-af95-db484b003bb8 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:17.865999 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1278/2556] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:18.128018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8ef0f-6601-4620-a28e-331a76f854e9 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:18.129596 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-61b8ef0f-6601-4620-a28e-331a76f854e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:18.144219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8ef0f-6601-4620-a28e-331a76f854e9 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:18.150356 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:18.151228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:18.151513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:18.151797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] PATH_INFO: `/v3/projects/830ac0a98b3145b79670f1d5f13e1da4` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:18.153019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=830ac0a98b3145b79670f1d5f13e1da4)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:18.154946 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:18.208479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '830ac0a98b3145b79670f1d5f13e1da4', 'request_id': 'req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:18.214440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '830ac0a98b3145b79670f1d5f13e1da4', 'request_id': 'req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:18.219730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '830ac0a98b3145b79670f1d5f13e1da4', 'request_id': 'req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:18.232720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] The token cache is being invalidate because project 830ac0a98b3145b79670f1d5f13e1da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:17:18.233000 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:18.233609 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:18.235158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1279/2557] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:17:18 2022] DELETE /identity/v3/projects/830ac0a98b3145b79670f1d5f13e1da4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:18.239135 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3a9b8-7463-48d3-af95-db484b003bb8 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:18.248543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3a9b8-7463-48d3-af95-db484b003bb8 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:18.305095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:18.305957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:18.306242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:18.306521 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] PATH_INFO: `/v3/users/f3ce5b76ea6f4db9b3753e622487a721` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:18.307738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ce5b76ea6f4db9b3753e622487a721)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:18.309755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:18.355951 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ce5b76ea6f4db9b3753e622487a721'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:18.362575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ce5b76ea6f4db9b3753e622487a721'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:18.370202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ce5b76ea6f4db9b3753e622487a721'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:18.370865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ce5b76ea6f4db9b3753e622487a721'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:18.371410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ce5b76ea6f4db9b3753e622487a721'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:18.392964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1279/2558] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:18 2022] DELETE /identity/v3/users/f3ce5b76ea6f4db9b3753e622487a721 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:18.901922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:18.903516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:18.916843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a43e5-384d-4f8e-8ca5-9c8d5d371bde admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:18.972806 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:18.973765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:18.974049 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:18.974325 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] PATH_INFO: `/v3/projects/b6b62aa8883f4dc1911fb3b8bae55f2c` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:18.975495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b62aa8883f4dc1911fb3b8bae55f2c)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:18.977441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:19.021751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b62aa8883f4dc1911fb3b8bae55f2c', 'request_id': 'req-4494c607-957b-400d-86d3-61c4ac892e4e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.027599 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b62aa8883f4dc1911fb3b8bae55f2c', 'request_id': 'req-4494c607-957b-400d-86d3-61c4ac892e4e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.032850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b62aa8883f4dc1911fb3b8bae55f2c', 'request_id': 'req-4494c607-957b-400d-86d3-61c4ac892e4e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.045004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] The token cache is being invalidate because project b6b62aa8883f4dc1911fb3b8bae55f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:17:19.045353 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.046001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.047619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1280/2559] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:17:18 2022] DELETE /identity/v3/projects/b6b62aa8883f4dc1911fb3b8bae55f2c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:17:19.052309 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:19.053881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:19.067936 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f675c11-cba5-44ff-ac4a-79f8a46137c5 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:19.122707 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600fef4-67e4-456b-94fc-2a542ee62643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:19.123560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600fef4-67e4-456b-94fc-2a542ee62643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:19.123839 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600fef4-67e4-456b-94fc-2a542ee62643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:19.124111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600fef4-67e4-456b-94fc-2a542ee62643 admin admin] PATH_INFO: `/v3/users/b224e4004ad2434185ed8f6766bc0502` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:19.125297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600fef4-67e4-456b-94fc-2a542ee62643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b224e4004ad2434185ed8f6766bc0502)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:19.127186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600fef4-67e4-456b-94fc-2a542ee62643 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:19.174371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d600fef4-67e4-456b-94fc-2a542ee62643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b224e4004ad2434185ed8f6766bc0502'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.181977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d600fef4-67e4-456b-94fc-2a542ee62643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b224e4004ad2434185ed8f6766bc0502'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.188943 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d600fef4-67e4-456b-94fc-2a542ee62643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b224e4004ad2434185ed8f6766bc0502'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.189561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d600fef4-67e4-456b-94fc-2a542ee62643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b224e4004ad2434185ed8f6766bc0502'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.190171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d600fef4-67e4-456b-94fc-2a542ee62643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b224e4004ad2434185ed8f6766bc0502'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.206752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1280/2560] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:19 2022] DELETE /identity/v3/users/b224e4004ad2434185ed8f6766bc0502 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:17:19.468201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:19.469759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:19.484455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494c607-957b-400d-86d3-61c4ac892e4e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:19.540868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:19.541727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:19.542011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:19.542292 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] PATH_INFO: `/v3/projects/7ac7f059587041f79f25e78be71ee735` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:19.543473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac7f059587041f79f25e78be71ee735)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:19.545453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:19.591315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac7f059587041f79f25e78be71ee735', 'request_id': 'req-565f8140-d4d4-4546-8a4d-17e96a38d672'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.597934 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac7f059587041f79f25e78be71ee735', 'request_id': 'req-565f8140-d4d4-4546-8a4d-17e96a38d672'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.604145 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac7f059587041f79f25e78be71ee735', 'request_id': 'req-565f8140-d4d4-4546-8a4d-17e96a38d672'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.616732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] The token cache is being invalidate because project 7ac7f059587041f79f25e78be71ee735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:17:19.617020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.617659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-565f8140-d4d4-4546-8a4d-17e96a38d672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:19.619197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1281/2561] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:17:19 2022] DELETE /identity/v3/projects/7ac7f059587041f79f25e78be71ee735 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:19.623920 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c2555-94d8-49b6-9ae6-34fcbceb9f6f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:19.624310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c2555-94d8-49b6-9ae6-34fcbceb9f6f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:19.624586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c2555-94d8-49b6-9ae6-34fcbceb9f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:19.642498 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-052c2555-94d8-49b6-9ae6-34fcbceb9f6f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:19.643671 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-052c2555-94d8-49b6-9ae6-34fcbceb9f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:19.703250 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1281/2562] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:19.711024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3bd70-2444-4202-9621-348ab15f6b6e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:19.711291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3bd70-2444-4202-9621-348ab15f6b6e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:19.711521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3bd70-2444-4202-9621-348ab15f6b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:19.731117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-65e3bd70-2444-4202-9621-348ab15f6b6e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:19.732371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-65e3bd70-2444-4202-9621-348ab15f6b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:19.741832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1282/2563] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:19.745900 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c2555-94d8-49b6-9ae6-34fcbceb9f6f None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:19.756677 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c2555-94d8-49b6-9ae6-34fcbceb9f6f None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:19.761266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76927b-b352-4a96-914b-c8feb936b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:19.761955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76927b-b352-4a96-914b-c8feb936b8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:19.762235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76927b-b352-4a96-914b-c8feb936b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:19.762636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76927b-b352-4a96-914b-c8feb936b8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:19.764096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76927b-b352-4a96-914b-c8feb936b8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:17:19.764096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76927b-b352-4a96-914b-c8feb936b8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:19.765297 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76927b-b352-4a96-914b-c8feb936b8e1 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:19.777426 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1282/2564] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:17:19.781873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3bd70-2444-4202-9621-348ab15f6b6e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:19.791545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3bd70-2444-4202-9621-348ab15f6b6e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:19.801384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d3f2b-26ab-4ec5-af01-98dd39227cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:19.803606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d3f2b-26ab-4ec5-af01-98dd39227cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:19.804011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d3f2b-26ab-4ec5-af01-98dd39227cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:19.804325 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d3f2b-26ab-4ec5-af01-98dd39227cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:19.805042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d3f2b-26ab-4ec5-af01-98dd39227cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:19.806966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d3f2b-26ab-4ec5-af01-98dd39227cd1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:19.835511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1283/2565] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:17:19 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:17:19.839648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76927b-b352-4a96-914b-c8feb936b8e1 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:19.850502 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76927b-b352-4a96-914b-c8feb936b8e1 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:19.916492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caa26f-4685-4c1d-9625-f28da2b8557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:19.917175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caa26f-4685-4c1d-9625-f28da2b8557d admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:19.917504 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caa26f-4685-4c1d-9625-f28da2b8557d admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:19.917796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caa26f-4685-4c1d-9625-f28da2b8557d admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:19.918905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32caa26f-4685-4c1d-9625-f28da2b8557d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:19.920438 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32caa26f-4685-4c1d-9625-f28da2b8557d admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:19.944217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1283/2566] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:17:19 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:17:19.947096 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d3f2b-26ab-4ec5-af01-98dd39227cd1 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:19.957772 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d3f2b-26ab-4ec5-af01-98dd39227cd1 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:19.963269 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dddca-240c-4d7e-a90a-091f56a18fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:19.963875 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dddca-240c-4d7e-a90a-091f56a18fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:19.964325 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dddca-240c-4d7e-a90a-091f56a18fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:19.964607 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dddca-240c-4d7e-a90a-091f56a18fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:19.965412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dddca-240c-4d7e-a90a-091f56a18fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:19.967237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dddca-240c-4d7e-a90a-091f56a18fb7 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:19.984170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1284/2567] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:19.985537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caa26f-4685-4c1d-9625-f28da2b8557d admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:19.997029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caa26f-4685-4c1d-9625-f28da2b8557d admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:20.001820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d7c2b-0209-429a-be56-f27309bb907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:20.002648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d7c2b-0209-429a-be56-f27309bb907f admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:20.002947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d7c2b-0209-429a-be56-f27309bb907f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:20.003229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d7c2b-0209-429a-be56-f27309bb907f admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:20.003966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d7c2b-0209-429a-be56-f27309bb907f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:20.005661 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d7c2b-0209-429a-be56-f27309bb907f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:20.016134 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1284/2568] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:20.020429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dddca-240c-4d7e-a90a-091f56a18fb7 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:20.030266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dddca-240c-4d7e-a90a-091f56a18fb7 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:20.036632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bd9a8-70ef-48ed-9d5a-be4e4576500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:20.037574 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bd9a8-70ef-48ed-9d5a-be4e4576500d admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:20.037862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bd9a8-70ef-48ed-9d5a-be4e4576500d admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:20.038138 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bd9a8-70ef-48ed-9d5a-be4e4576500d admin admin] PATH_INFO: `/v3/projects/f55775e2790046029256efb09b501c89/users/291b520eed8f446b86296165fb5d658a/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:20.055172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bd9a8-70ef-48ed-9d5a-be4e4576500d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55775e2790046029256efb09b501c89, user_id=291b520eed8f446b86296165fb5d658a, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:20.058861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bd9a8-70ef-48ed-9d5a-be4e4576500d admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:20.075247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1285/2569] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:20 2022] PUT /identity/v3/projects/f55775e2790046029256efb09b501c89/users/291b520eed8f446b86296165fb5d658a/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:20.080450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67902d-342a-49a7-a79a-5e5d6df69b37 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:20.080951 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67902d-342a-49a7-a79a-5e5d6df69b37 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:20.081053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67902d-342a-49a7-a79a-5e5d6df69b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:20.099271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-ea67902d-342a-49a7-a79a-5e5d6df69b37 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:20.100490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ea67902d-342a-49a7-a79a-5e5d6df69b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:20.159694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1285/2570] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:20.206638 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bd9a8-70ef-48ed-9d5a-be4e4576500d admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:20.208899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e75bd9a8-70ef-48ed-9d5a-be4e4576500d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:20.265363 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bd9a8-70ef-48ed-9d5a-be4e4576500d admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:20.269045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645882f-8538-45ea-b447-44393c9dfbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:20.269691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645882f-8538-45ea-b447-44393c9dfbdf service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:20.269979 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645882f-8538-45ea-b447-44393c9dfbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:20.270799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645882f-8538-45ea-b447-44393c9dfbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:20.279916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645882f-8538-45ea-b447-44393c9dfbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:20.281388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645882f-8538-45ea-b447-44393c9dfbdf service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:20.291645 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1286/2571] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:21.098005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0041abc-8fde-43d9-af91-97ce23f2b9b2 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:21.099439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0041abc-8fde-43d9-af91-97ce23f2b9b2 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:21.099725 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0041abc-8fde-43d9-af91-97ce23f2b9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:21.128438 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e0041abc-8fde-43d9-af91-97ce23f2b9b2 None None] MFA Rules not processed for user `291b520eed8f446b86296165fb5d658a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:21.129945 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e0041abc-8fde-43d9-af91-97ce23f2b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:21.208360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1286/2572] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:21.216568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645882f-8538-45ea-b447-44393c9dfbdf service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:21.218047 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2645882f-8538-45ea-b447-44393c9dfbdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:21.276083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645882f-8538-45ea-b447-44393c9dfbdf service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:21.279831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689369a-5670-413a-b1e1-fe44543b5660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:21.280514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689369a-5670-413a-b1e1-fe44543b5660 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:21.280791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689369a-5670-413a-b1e1-fe44543b5660 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:21.281070 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689369a-5670-413a-b1e1-fe44543b5660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:21.290988 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689369a-5670-413a-b1e1-fe44543b5660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:21.292672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689369a-5670-413a-b1e1-fe44543b5660 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:21.301762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1287/2573] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:22.666978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed11cb-92ef-48f2-a75a-1e4cfbccd2a1 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:22.667479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed11cb-92ef-48f2-a75a-1e4cfbccd2a1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:22.667596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed11cb-92ef-48f2-a75a-1e4cfbccd2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:22.685091 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-efed11cb-92ef-48f2-a75a-1e4cfbccd2a1 None None] MFA Rules not processed for user `291b520eed8f446b86296165fb5d658a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:22.686286 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-efed11cb-92ef-48f2-a75a-1e4cfbccd2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:22.693406 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1287/2574] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:26.542854 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689369a-5670-413a-b1e1-fe44543b5660 service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:26.544270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-8689369a-5670-413a-b1e1-fe44543b5660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:26.555979 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689369a-5670-413a-b1e1-fe44543b5660 service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:26.559454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cddc90-1117-4c11-a8d5-ecaeafbe42cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:26.560082 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cddc90-1117-4c11-a8d5-ecaeafbe42cf service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:26.560395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cddc90-1117-4c11-a8d5-ecaeafbe42cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:26.560669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cddc90-1117-4c11-a8d5-ecaeafbe42cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:26.562332 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-22cddc90-1117-4c11-a8d5-ecaeafbe42cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:26.574169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cddc90-1117-4c11-a8d5-ecaeafbe42cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:26.575844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cddc90-1117-4c11-a8d5-ecaeafbe42cf service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:26.585745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1288/2575] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:29.210546 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed11cb-92ef-48f2-a75a-1e4cfbccd2a1 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:29.224506 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed11cb-92ef-48f2-a75a-1e4cfbccd2a1 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:29.228596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42087cd-9347-4658-b74b-e4229cfec625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:29.229334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42087cd-9347-4658-b74b-e4229cfec625 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:29.229689 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42087cd-9347-4658-b74b-e4229cfec625 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:29.230041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42087cd-9347-4658-b74b-e4229cfec625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:29.232021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c42087cd-9347-4658-b74b-e4229cfec625 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:29.327881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42087cd-9347-4658-b74b-e4229cfec625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:29.330006 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42087cd-9347-4658-b74b-e4229cfec625 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:29.358122 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1288/2576] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:29.583783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cddc90-1117-4c11-a8d5-ecaeafbe42cf service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:29.585266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-22cddc90-1117-4c11-a8d5-ecaeafbe42cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:29.605677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cddc90-1117-4c11-a8d5-ecaeafbe42cf service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:29.615660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2885a-4c49-44b4-97b7-86a1be1f6ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:29.616740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2885a-4c49-44b4-97b7-86a1be1f6ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:29.617153 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2885a-4c49-44b4-97b7-86a1be1f6ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:29.617673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2885a-4c49-44b4-97b7-86a1be1f6ad4 admin admin] PATH_INFO: `/v3/users/586e15d5d16543e6b70c87fbf9079e9e` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:29.634357 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2885a-4c49-44b4-97b7-86a1be1f6ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=586e15d5d16543e6b70c87fbf9079e9e)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:29.636346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2885a-4c49-44b4-97b7-86a1be1f6ad4 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:29.687731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-35b2885a-4c49-44b4-97b7-86a1be1f6ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586e15d5d16543e6b70c87fbf9079e9e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:29.688701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-35b2885a-4c49-44b4-97b7-86a1be1f6ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586e15d5d16543e6b70c87fbf9079e9e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:29.697597 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-35b2885a-4c49-44b4-97b7-86a1be1f6ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586e15d5d16543e6b70c87fbf9079e9e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:29.708005 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-35b2885a-4c49-44b4-97b7-86a1be1f6ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586e15d5d16543e6b70c87fbf9079e9e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:29.708823 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-35b2885a-4c49-44b4-97b7-86a1be1f6ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586e15d5d16543e6b70c87fbf9079e9e'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:29.731343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1289/2577] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:29 2022] DELETE /identity/v3/users/586e15d5d16543e6b70c87fbf9079e9e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:29.968452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42087cd-9347-4658-b74b-e4229cfec625 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:29.979818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42087cd-9347-4658-b74b-e4229cfec625 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:30.036263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:30.037501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.037787 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.038065 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] PATH_INFO: `/v3/projects/27acd98621cd4a51ac46fb12e1824168` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.048293 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27acd98621cd4a51ac46fb12e1824168)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:30.050204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:30.095796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27acd98621cd4a51ac46fb12e1824168', 'request_id': 'req-d8961c20-cb95-4fb7-8b9e-23e59762d700'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:30.103618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27acd98621cd4a51ac46fb12e1824168', 'request_id': 'req-d8961c20-cb95-4fb7-8b9e-23e59762d700'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:30.110556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27acd98621cd4a51ac46fb12e1824168', 'request_id': 'req-d8961c20-cb95-4fb7-8b9e-23e59762d700'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:30.120976 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] The token cache is being invalidate because project 27acd98621cd4a51ac46fb12e1824168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:17:30.121264 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:30.121905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-d8961c20-cb95-4fb7-8b9e-23e59762d700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:30.123459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1289/2578] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:17:29 2022] DELETE /identity/v3/projects/27acd98621cd4a51ac46fb12e1824168 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:30.128663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f674-82d4-424b-a552-f7fda1d14522 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.128953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f674-82d4-424b-a552-f7fda1d14522 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.129232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44f674-82d4-424b-a552-f7fda1d14522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.147723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-bd44f674-82d4-424b-a552-f7fda1d14522 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:30.148932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bd44f674-82d4-424b-a552-f7fda1d14522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:30.205127 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1290/2579] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:30.213842 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17eb0a-8541-4026-8daf-df144001e93a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.214314 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17eb0a-8541-4026-8daf-df144001e93a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.214409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17eb0a-8541-4026-8daf-df144001e93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.232220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-bc17eb0a-8541-4026-8daf-df144001e93a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:30.233490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-bc17eb0a-8541-4026-8daf-df144001e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:30.241405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1290/2580] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:30.245707 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f674-82d4-424b-a552-f7fda1d14522 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:30.259934 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44f674-82d4-424b-a552-f7fda1d14522 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:30.264525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc6eb8-51a4-4528-b9f5-e5064a59858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:30.265186 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6eb8-51a4-4528-b9f5-e5064a59858c admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.265496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6eb8-51a4-4528-b9f5-e5064a59858c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.265749 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc6eb8-51a4-4528-b9f5-e5064a59858c admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.266487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc6eb8-51a4-4528-b9f5-e5064a59858c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:17:30.266797 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc6eb8-51a4-4528-b9f5-e5064a59858c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:30.268444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc6eb8-51a4-4528-b9f5-e5064a59858c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:30.281228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1291/2581] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:17:30.286508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17eb0a-8541-4026-8daf-df144001e93a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:30.296028 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17eb0a-8541-4026-8daf-df144001e93a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:30.300697 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54c29-94e0-4a9b-95e7-84e29eef9e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:30.301405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54c29-94e0-4a9b-95e7-84e29eef9e55 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.301685 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54c29-94e0-4a9b-95e7-84e29eef9e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.301955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54c29-94e0-4a9b-95e7-84e29eef9e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.302654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b54c29-94e0-4a9b-95e7-84e29eef9e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:30.304600 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b54c29-94e0-4a9b-95e7-84e29eef9e55 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:30.336456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1291/2582] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:17:30 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:17:30.337659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc6eb8-51a4-4528-b9f5-e5064a59858c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:30.347997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc6eb8-51a4-4528-b9f5-e5064a59858c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:30.407215 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592550f-a585-4a19-932f-169a30f6e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:30.407903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592550f-a585-4a19-932f-169a30f6e15a admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.408247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592550f-a585-4a19-932f-169a30f6e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.408530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592550f-a585-4a19-932f-169a30f6e15a admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.409249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592550f-a585-4a19-932f-169a30f6e15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:30.411652 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592550f-a585-4a19-932f-169a30f6e15a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:30.435525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1292/2583] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:17:30 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:17:30.436978 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54c29-94e0-4a9b-95e7-84e29eef9e55 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:30.448133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54c29-94e0-4a9b-95e7-84e29eef9e55 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:30.453123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce08840-8d6f-45a1-b0cf-d85f5b81fe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:30.453793 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce08840-8d6f-45a1-b0cf-d85f5b81fe96 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.454075 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce08840-8d6f-45a1-b0cf-d85f5b81fe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.454348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce08840-8d6f-45a1-b0cf-d85f5b81fe96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.455077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce08840-8d6f-45a1-b0cf-d85f5b81fe96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:30.456714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce08840-8d6f-45a1-b0cf-d85f5b81fe96 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:30.468320 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1292/2584] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:30.472272 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592550f-a585-4a19-932f-169a30f6e15a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:30.482895 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592550f-a585-4a19-932f-169a30f6e15a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:30.487544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bd9f3-1632-4962-81a0-d9a9f60fbff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:30.488321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd9f3-1632-4962-81a0-d9a9f60fbff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.488673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd9f3-1632-4962-81a0-d9a9f60fbff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.489026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd9f3-1632-4962-81a0-d9a9f60fbff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.489825 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bd9f3-1632-4962-81a0-d9a9f60fbff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:30.491514 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bd9f3-1632-4962-81a0-d9a9f60fbff6 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:30.501959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1293/2585] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:30.506800 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce08840-8d6f-45a1-b0cf-d85f5b81fe96 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:30.517050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce08840-8d6f-45a1-b0cf-d85f5b81fe96 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:30.523576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f939cc-81cd-40a4-bf0c-3087571d4f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:30.525023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f939cc-81cd-40a4-bf0c-3087571d4f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.525517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f939cc-81cd-40a4-bf0c-3087571d4f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.526149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f939cc-81cd-40a4-bf0c-3087571d4f40 admin admin] PATH_INFO: `/v3/projects/ae9f1c5826d944dc90b136eff44f3914/users/9d9a9d743c344a998aa1049876cba272/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.545383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f939cc-81cd-40a4-bf0c-3087571d4f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9f1c5826d944dc90b136eff44f3914, user_id=9d9a9d743c344a998aa1049876cba272, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:30.548099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f939cc-81cd-40a4-bf0c-3087571d4f40 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:30.561373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1293/2586] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:30 2022] PUT /identity/v3/projects/ae9f1c5826d944dc90b136eff44f3914/users/9d9a9d743c344a998aa1049876cba272/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:30.571827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ac349-8f7d-4104-8f07-bcd695b7e5d9 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.572121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ac349-8f7d-4104-8f07-bcd695b7e5d9 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.572450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ac349-8f7d-4104-8f07-bcd695b7e5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.601045 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-8b7ac349-8f7d-4104-8f07-bcd695b7e5d9 None None] MFA Rules not processed for user `9d9a9d743c344a998aa1049876cba272`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:30.602251 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-8b7ac349-8f7d-4104-8f07-bcd695b7e5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:30.665265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1294/2587] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:30.669643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f939cc-81cd-40a4-bf0c-3087571d4f40 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:30.729915 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f939cc-81cd-40a4-bf0c-3087571d4f40 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:30.734503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798d55d-68fe-4b9c-8b4b-ea5c6703f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:30.735161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798d55d-68fe-4b9c-8b4b-ea5c6703f32c admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.735443 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798d55d-68fe-4b9c-8b4b-ea5c6703f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.735716 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798d55d-68fe-4b9c-8b4b-ea5c6703f32c admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.736470 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798d55d-68fe-4b9c-8b4b-ea5c6703f32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:30.738364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798d55d-68fe-4b9c-8b4b-ea5c6703f32c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:30.764997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1294/2588] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:17:30 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:17:30.768522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ac349-8f7d-4104-8f07-bcd695b7e5d9 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:30.779103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ac349-8f7d-4104-8f07-bcd695b7e5d9 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:30.836137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c684-fb7e-42cd-9af8-310be967fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:30.836849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c684-fb7e-42cd-9af8-310be967fd6e admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.837134 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c684-fb7e-42cd-9af8-310be967fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.837410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c684-fb7e-42cd-9af8-310be967fd6e admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.838142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255c684-fb7e-42cd-9af8-310be967fd6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:30.840051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255c684-fb7e-42cd-9af8-310be967fd6e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:30.859883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1295/2589] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:17:30 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:17:30.864584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798d55d-68fe-4b9c-8b4b-ea5c6703f32c admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:30.874905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798d55d-68fe-4b9c-8b4b-ea5c6703f32c admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:30.880211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1359fd-bad2-4bb6-8525-c156fff74e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:30.880927 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1359fd-bad2-4bb6-8525-c156fff74e85 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.881341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1359fd-bad2-4bb6-8525-c156fff74e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.881719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1359fd-bad2-4bb6-8525-c156fff74e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.882704 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1359fd-bad2-4bb6-8525-c156fff74e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:30.884693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1359fd-bad2-4bb6-8525-c156fff74e85 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:30.895482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1295/2590] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:17:30.899590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c684-fb7e-42cd-9af8-310be967fd6e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:30.909350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c684-fb7e-42cd-9af8-310be967fd6e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:30.914057 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45b6da-70ce-4494-9a1b-d1939fc3ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:30.914923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45b6da-70ce-4494-9a1b-d1939fc3ee3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:30.915208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45b6da-70ce-4494-9a1b-d1939fc3ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:30.915482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45b6da-70ce-4494-9a1b-d1939fc3ee3c admin admin] PATH_INFO: `/v3/projects/c1aa0e170b0f4db5918bc8dafe724373/users/ff1cd3b2650d463d9601f1eb4365edaf/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:30.930660 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45b6da-70ce-4494-9a1b-d1939fc3ee3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1aa0e170b0f4db5918bc8dafe724373, user_id=ff1cd3b2650d463d9601f1eb4365edaf, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:30.933388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45b6da-70ce-4494-9a1b-d1939fc3ee3c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:30.949365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1296/2591] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:30 2022] PUT /identity/v3/projects/c1aa0e170b0f4db5918bc8dafe724373/users/ff1cd3b2650d463d9601f1eb4365edaf/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:30.953322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1359fd-bad2-4bb6-8525-c156fff74e85 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:30.963643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1359fd-bad2-4bb6-8525-c156fff74e85 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:31.025805 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f4941-7006-425d-aacf-410738bdfeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:31.026518 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f4941-7006-425d-aacf-410738bdfeab admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:31.026801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f4941-7006-425d-aacf-410738bdfeab admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:31.027076 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f4941-7006-425d-aacf-410738bdfeab admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:31.027803 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f4941-7006-425d-aacf-410738bdfeab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:31.029856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f4941-7006-425d-aacf-410738bdfeab admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:31.041694 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1296/2592] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:31.045932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45b6da-70ce-4494-9a1b-d1939fc3ee3c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:31.057249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45b6da-70ce-4494-9a1b-d1939fc3ee3c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:31.062209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc842cb-63a9-4b82-a152-3a86d8f45c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:31.063100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc842cb-63a9-4b82-a152-3a86d8f45c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:31.063379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc842cb-63a9-4b82-a152-3a86d8f45c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:31.063653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc842cb-63a9-4b82-a152-3a86d8f45c34 admin admin] PATH_INFO: `/v3/projects/c1aa0e170b0f4db5918bc8dafe724373/users/ff1cd3b2650d463d9601f1eb4365edaf/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:31.065672 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc842cb-63a9-4b82-a152-3a86d8f45c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1aa0e170b0f4db5918bc8dafe724373, user_id=ff1cd3b2650d463d9601f1eb4365edaf, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:31.069031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc842cb-63a9-4b82-a152-3a86d8f45c34 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:31.088527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1297/2593] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:31 2022] PUT /identity/v3/projects/c1aa0e170b0f4db5918bc8dafe724373/users/ff1cd3b2650d463d9601f1eb4365edaf/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:31.091843 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c502-beef-4c08-b4e3-f0ac04a93d1a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:31.092213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c502-beef-4c08-b4e3-f0ac04a93d1a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:31.092433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38c502-beef-4c08-b4e3-f0ac04a93d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:31.121326 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-0e38c502-beef-4c08-b4e3-f0ac04a93d1a None None] MFA Rules not processed for user `ff1cd3b2650d463d9601f1eb4365edaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:31.122531 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0e38c502-beef-4c08-b4e3-f0ac04a93d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:31.195471 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1297/2594] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:31.206549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc842cb-63a9-4b82-a152-3a86d8f45c34 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:31.208700 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3dc842cb-63a9-4b82-a152-3a86d8f45c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:31.266118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc842cb-63a9-4b82-a152-3a86d8f45c34 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:31.269813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efa55f-cf92-4684-a42b-8805280ffeeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:31.270472 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa55f-cf92-4684-a42b-8805280ffeeb service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:31.270900 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa55f-cf92-4684-a42b-8805280ffeeb service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:31.271218 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efa55f-cf92-4684-a42b-8805280ffeeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:31.328135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efa55f-cf92-4684-a42b-8805280ffeeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:31.329658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efa55f-cf92-4684-a42b-8805280ffeeb service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:31.338883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1298/2595] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:37.993069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38c502-beef-4c08-b4e3-f0ac04a93d1a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:37.994480 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0e38c502-beef-4c08-b4e3-f0ac04a93d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:38.006562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38c502-beef-4c08-b4e3-f0ac04a93d1a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:38.010112 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf300b-f2c7-422f-92b9-740b8414545f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:38.010745 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf300b-f2c7-422f-92b9-740b8414545f service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:38.011028 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf300b-f2c7-422f-92b9-740b8414545f service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:38.011303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf300b-f2c7-422f-92b9-740b8414545f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:38.020101 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf300b-f2c7-422f-92b9-740b8414545f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:38.021550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf300b-f2c7-422f-92b9-740b8414545f service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:38.030688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1298/2596] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:45.739054 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e68fd-6a4f-4823-bc35-d30bb262dbc7 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:45.740084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e68fd-6a4f-4823-bc35-d30bb262dbc7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:45.740398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e68fd-6a4f-4823-bc35-d30bb262dbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:45.757604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-d48e68fd-6a4f-4823-bc35-d30bb262dbc7 None None] MFA Rules not processed for user `291b520eed8f446b86296165fb5d658a`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:45.758779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-d48e68fd-6a4f-4823-bc35-d30bb262dbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:45.812308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1299/2597] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:46.351666 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf300b-f2c7-422f-92b9-740b8414545f service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:46.353111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-9fcf300b-f2c7-422f-92b9-740b8414545f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:46.421283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf300b-f2c7-422f-92b9-740b8414545f service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:46.426221 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71af1f-06d1-415d-8154-f957978f3b9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5222a62941948229324ec8c073caf86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:46.426894 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71af1f-06d1-415d-8154-f957978f3b9e service placement] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:46.427349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71af1f-06d1-415d-8154-f957978f3b9e service placement] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:46.427631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71af1f-06d1-415d-8154-f957978f3b9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:46.429391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-aa71af1f-06d1-415d-8154-f957978f3b9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:46.440952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71af1f-06d1-415d-8154-f957978f3b9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:46.442526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71af1f-06d1-415d-8154-f957978f3b9e service placement] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:46.452445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1299/2598] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:51.234378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e68fd-6a4f-4823-bc35-d30bb262dbc7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:51.236372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-d48e68fd-6a4f-4823-bc35-d30bb262dbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:51.325617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e68fd-6a4f-4823-bc35-d30bb262dbc7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:51.331186 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf746d4-2671-4cc0-b924-e23b8bc90169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:51.331848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf746d4-2671-4cc0-b924-e23b8bc90169 service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:51.332133 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf746d4-2671-4cc0-b924-e23b8bc90169 service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:51.332444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf746d4-2671-4cc0-b924-e23b8bc90169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:51.334270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bbf746d4-2671-4cc0-b924-e23b8bc90169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:51.346288 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf746d4-2671-4cc0-b924-e23b8bc90169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:51.347885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf746d4-2671-4cc0-b924-e23b8bc90169 service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:51.358862 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1300/2599] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:51.557292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71af1f-06d1-415d-8154-f957978f3b9e service placement] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:51.558689 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-aa71af1f-06d1-415d-8154-f957978f3b9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:51.616884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71af1f-06d1-415d-8154-f957978f3b9e service placement] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:51.620522 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6151b-5422-495d-a243-6dd1d328d1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:51.621165 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6151b-5422-495d-a243-6dd1d328d1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:51.621446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6151b-5422-495d-a243-6dd1d328d1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:51.621722 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6151b-5422-495d-a243-6dd1d328d1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:51.623503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ddf6151b-5422-495d-a243-6dd1d328d1a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:51.687038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6151b-5422-495d-a243-6dd1d328d1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:51.688560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6151b-5422-495d-a243-6dd1d328d1a5 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:51.698923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1300/2600] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:54.681511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf746d4-2671-4cc0-b924-e23b8bc90169 service nova] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:54.682990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bbf746d4-2671-4cc0-b924-e23b8bc90169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:54.698937 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf746d4-2671-4cc0-b924-e23b8bc90169 service nova] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:54.702323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91166523-a9a2-4af3-bcde-b57085045071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:54.703193 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91166523-a9a2-4af3-bcde-b57085045071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:54.703477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91166523-a9a2-4af3-bcde-b57085045071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:54.703755 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91166523-a9a2-4af3-bcde-b57085045071 admin admin] PATH_INFO: `/v3/users/e8a6a76a94ca4fb197c7b1705b809c54` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:54.704969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91166523-a9a2-4af3-bcde-b57085045071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a6a76a94ca4fb197c7b1705b809c54)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:54.706885 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91166523-a9a2-4af3-bcde-b57085045071 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:54.761191 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-91166523-a9a2-4af3-bcde-b57085045071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a6a76a94ca4fb197c7b1705b809c54'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:54.761847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-91166523-a9a2-4af3-bcde-b57085045071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a6a76a94ca4fb197c7b1705b809c54'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:54.770834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-91166523-a9a2-4af3-bcde-b57085045071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a6a76a94ca4fb197c7b1705b809c54'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:54.780436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-91166523-a9a2-4af3-bcde-b57085045071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a6a76a94ca4fb197c7b1705b809c54'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:54.781006 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-91166523-a9a2-4af3-bcde-b57085045071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a6a76a94ca4fb197c7b1705b809c54'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:54.803978 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1301/2601] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:54 2022] DELETE /identity/v3/users/e8a6a76a94ca4fb197c7b1705b809c54 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:54.978832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6151b-5422-495d-a243-6dd1d328d1a5 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:54.988990 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6151b-5422-495d-a243-6dd1d328d1a5 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:55.046258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:55.047105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:55.047386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:55.047657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] PATH_INFO: `/v3/projects/cd2c9994923540748c1513406e3e7ffc` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:55.048818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2c9994923540748c1513406e3e7ffc)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:55.050693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:55.095857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2c9994923540748c1513406e3e7ffc', 'request_id': 'req-5445fee6-90c6-4711-b502-6accf74a4220'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:55.103557 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2c9994923540748c1513406e3e7ffc', 'request_id': 'req-5445fee6-90c6-4711-b502-6accf74a4220'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:55.109677 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2c9994923540748c1513406e3e7ffc', 'request_id': 'req-5445fee6-90c6-4711-b502-6accf74a4220'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:55.120530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] The token cache is being invalidate because project cd2c9994923540748c1513406e3e7ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:17:55.120815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:55.121442 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5445fee6-90c6-4711-b502-6accf74a4220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:55.122999 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1301/2602] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:17:54 2022] DELETE /identity/v3/projects/cd2c9994923540748c1513406e3e7ffc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:55.128206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed3d5-366c-4ae2-9dae-0900173fdccd None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:55.128520 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed3d5-366c-4ae2-9dae-0900173fdccd None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:55.128793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed3d5-366c-4ae2-9dae-0900173fdccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:55.146024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c80ed3d5-366c-4ae2-9dae-0900173fdccd None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:55.147226 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c80ed3d5-366c-4ae2-9dae-0900173fdccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:55.203265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1302/2603] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:55.211145 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb500e2-a2f2-4d05-ace9-a70fe785e180 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:55.211427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb500e2-a2f2-4d05-ace9-a70fe785e180 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:55.211698 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb500e2-a2f2-4d05-ace9-a70fe785e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:55.229733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-3bb500e2-a2f2-4d05-ace9-a70fe785e180 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:55.230933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-3bb500e2-a2f2-4d05-ace9-a70fe785e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:55.238670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1302/2604] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:55.243448 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ed3d5-366c-4ae2-9dae-0900173fdccd None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:55.252876 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ed3d5-366c-4ae2-9dae-0900173fdccd None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:55.257626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81237656-3d99-4861-8252-2063609b8314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:55.258285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237656-3d99-4861-8252-2063609b8314 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:55.258569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237656-3d99-4861-8252-2063609b8314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:55.258848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81237656-3d99-4861-8252-2063609b8314 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:55.259579 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81237656-3d99-4861-8252-2063609b8314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:17:55.259892 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81237656-3d99-4861-8252-2063609b8314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:55.261530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81237656-3d99-4861-8252-2063609b8314 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:55.273469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1303/2605] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:17:55.277542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb500e2-a2f2-4d05-ace9-a70fe785e180 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:55.286890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb500e2-a2f2-4d05-ace9-a70fe785e180 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:55.291386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae561f4-4e88-44b8-b9fe-93369dd8563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:55.292023 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae561f4-4e88-44b8-b9fe-93369dd8563a admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:55.292337 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae561f4-4e88-44b8-b9fe-93369dd8563a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:55.292617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae561f4-4e88-44b8-b9fe-93369dd8563a admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:55.293300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae561f4-4e88-44b8-b9fe-93369dd8563a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:55.295163 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae561f4-4e88-44b8-b9fe-93369dd8563a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:55.319324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1303/2606] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:17:55 2022] POST /identity/v3/projects => generated 371 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:17:55.323385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81237656-3d99-4861-8252-2063609b8314 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:55.333958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81237656-3d99-4861-8252-2063609b8314 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:55.389100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906903ba-bd8d-4fe5-9a33-676d1fa0f6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:55.389840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906903ba-bd8d-4fe5-9a33-676d1fa0f6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:55.390348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906903ba-bd8d-4fe5-9a33-676d1fa0f6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:55.390829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906903ba-bd8d-4fe5-9a33-676d1fa0f6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:55.392120 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906903ba-bd8d-4fe5-9a33-676d1fa0f6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:55.397345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906903ba-bd8d-4fe5-9a33-676d1fa0f6b4 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:55.419751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1304/2607] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:17:55 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:17:55.424111 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae561f4-4e88-44b8-b9fe-93369dd8563a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:55.434363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae561f4-4e88-44b8-b9fe-93369dd8563a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:55.438940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82155b1f-a3e3-46d7-be03-4436f9a213df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:55.439587 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82155b1f-a3e3-46d7-be03-4436f9a213df admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:55.439865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82155b1f-a3e3-46d7-be03-4436f9a213df admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:55.440138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82155b1f-a3e3-46d7-be03-4436f9a213df admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:55.440890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82155b1f-a3e3-46d7-be03-4436f9a213df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:55.442483 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82155b1f-a3e3-46d7-be03-4436f9a213df admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:55.453799 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1304/2608] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:55.458673 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906903ba-bd8d-4fe5-9a33-676d1fa0f6b4 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:55.468157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906903ba-bd8d-4fe5-9a33-676d1fa0f6b4 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:55.472740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306c0c3-c380-4ccb-b3e1-213b3187782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:55.473384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c0c3-c380-4ccb-b3e1-213b3187782b admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:55.474265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c0c3-c380-4ccb-b3e1-213b3187782b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:55.474571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306c0c3-c380-4ccb-b3e1-213b3187782b admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:55.475400 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306c0c3-c380-4ccb-b3e1-213b3187782b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:55.477020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306c0c3-c380-4ccb-b3e1-213b3187782b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:55.486635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1305/2609] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:17:55.490569 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82155b1f-a3e3-46d7-be03-4436f9a213df admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:55.500274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82155b1f-a3e3-46d7-be03-4436f9a213df admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:55.504994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feca938-21a3-40b1-b6ed-1edd6560b4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:55.505879 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feca938-21a3-40b1-b6ed-1edd6560b4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:55.506161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feca938-21a3-40b1-b6ed-1edd6560b4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:55.506430 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feca938-21a3-40b1-b6ed-1edd6560b4d8 admin admin] PATH_INFO: `/v3/projects/433189fb223e42cc951a2e49ab594b5e/users/df177150e583426995918e85411af4bb/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:55.521180 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feca938-21a3-40b1-b6ed-1edd6560b4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=433189fb223e42cc951a2e49ab594b5e, user_id=df177150e583426995918e85411af4bb, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:55.523876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feca938-21a3-40b1-b6ed-1edd6560b4d8 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:55.537964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1305/2610] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:17:55 2022] PUT /identity/v3/projects/433189fb223e42cc951a2e49ab594b5e/users/df177150e583426995918e85411af4bb/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:55.548126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0e52-391c-4049-a4f0-4136788f9fc3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:55.548461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0e52-391c-4049-a4f0-4136788f9fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:55.548744 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0e52-391c-4049-a4f0-4136788f9fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:55.574639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-52fb0e52-391c-4049-a4f0-4136788f9fc3 None None] MFA Rules not processed for user `df177150e583426995918e85411af4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:55.576074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-52fb0e52-391c-4049-a4f0-4136788f9fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:55.642904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1306/2611] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:55.654940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feca938-21a3-40b1-b6ed-1edd6560b4d8 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:55.656696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1feca938-21a3-40b1-b6ed-1edd6560b4d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:55.731494 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feca938-21a3-40b1-b6ed-1edd6560b4d8 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:55.737009 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b77faf-a98f-4d33-b0ef-7b74a903bfe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:55.737654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77faf-a98f-4d33-b0ef-7b74a903bfe9 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:55.737940 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77faf-a98f-4d33-b0ef-7b74a903bfe9 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:55.738223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77faf-a98f-4d33-b0ef-7b74a903bfe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:55.746320 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b77faf-a98f-4d33-b0ef-7b74a903bfe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:55.747893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b77faf-a98f-4d33-b0ef-7b74a903bfe9 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:55.757262 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1306/2612] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:17:59.491487 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb0e52-391c-4049-a4f0-4136788f9fc3 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:59.550249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb0e52-391c-4049-a4f0-4136788f9fc3 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:59.555406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:59.556316 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:59.556604 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:59.556884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] PATH_INFO: `/v3/users/df177150e583426995918e85411af4bb` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:59.558067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df177150e583426995918e85411af4bb)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:59.559993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:59.604696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df177150e583426995918e85411af4bb'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:59.605348 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df177150e583426995918e85411af4bb'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:59.612025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df177150e583426995918e85411af4bb'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:59.619880 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df177150e583426995918e85411af4bb'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:59.620506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df177150e583426995918e85411af4bb'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:17:59.637603 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1307/2613] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:17:59 2022] DELETE /identity/v3/users/df177150e583426995918e85411af4bb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:17:59.642104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c80d5-9e43-4588-894e-cc860b2436cc None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:59.642560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c80d5-9e43-4588-894e-cc860b2436cc None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:59.642675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c80d5-9e43-4588-894e-cc860b2436cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:59.659555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-2c5c80d5-9e43-4588-894e-cc860b2436cc None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:17:59.660771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2c5c80d5-9e43-4588-894e-cc860b2436cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:59.718515 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1307/2614] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:17:59.727948 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:17:59.729359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:17:59.784848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c7c21-86a4-4312-a770-69d75b536529 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:17:59.788440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90132732-3588-40a6-b9dc-c443f169877b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:17:59.789071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90132732-3588-40a6-b9dc-c443f169877b service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:17:59.789351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90132732-3588-40a6-b9dc-c443f169877b service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:17:59.789625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90132732-3588-40a6-b9dc-c443f169877b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:17:59.798275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90132732-3588-40a6-b9dc-c443f169877b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:17:59.799697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90132732-3588-40a6-b9dc-c443f169877b service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:17:59.808817 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1308/2615] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:18:00.069577 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c80d5-9e43-4588-894e-cc860b2436cc None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:00.071464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2c5c80d5-9e43-4588-894e-cc860b2436cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:00.083717 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c80d5-9e43-4588-894e-cc860b2436cc None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:00.099590 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:00.101186 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.101491 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.101765 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] PATH_INFO: `/v3/projects/433189fb223e42cc951a2e49ab594b5e` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.102960 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=433189fb223e42cc951a2e49ab594b5e)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:00.104947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:00.151221 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433189fb223e42cc951a2e49ab594b5e', 'request_id': 'req-f75aa2c3-2765-4052-a689-9a41e24f3eb3'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:00.157641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433189fb223e42cc951a2e49ab594b5e', 'request_id': 'req-f75aa2c3-2765-4052-a689-9a41e24f3eb3'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:00.164766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433189fb223e42cc951a2e49ab594b5e', 'request_id': 'req-f75aa2c3-2765-4052-a689-9a41e24f3eb3'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:00.174824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] The token cache is being invalidate because project 433189fb223e42cc951a2e49ab594b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:00.175140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:00.175776 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f75aa2c3-2765-4052-a689-9a41e24f3eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:00.177351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1308/2616] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:00 2022] DELETE /identity/v3/projects/433189fb223e42cc951a2e49ab594b5e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:00.182244 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760b114-e903-4236-b399-c82c287121d0 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.182563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760b114-e903-4236-b399-c82c287121d0 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.182840 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760b114-e903-4236-b399-c82c287121d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.199650 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f760b114-e903-4236-b399-c82c287121d0 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:00.201111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f760b114-e903-4236-b399-c82c287121d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:00.258852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1309/2617] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:00.266468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a9bde-9287-4e9a-94d8-1de28dab411b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.266755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a9bde-9287-4e9a-94d8-1de28dab411b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.267031 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a9bde-9287-4e9a-94d8-1de28dab411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.285516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-3b0a9bde-9287-4e9a-94d8-1de28dab411b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:00.286687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-3b0a9bde-9287-4e9a-94d8-1de28dab411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:00.294419 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1309/2618] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:00.298493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760b114-e903-4236-b399-c82c287121d0 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:00.307902 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760b114-e903-4236-b399-c82c287121d0 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:00.312477 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d0fca-7fb2-400d-a902-6b09ac329575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:00.313056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d0fca-7fb2-400d-a902-6b09ac329575 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.313336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d0fca-7fb2-400d-a902-6b09ac329575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.313613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d0fca-7fb2-400d-a902-6b09ac329575 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.314330 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d0fca-7fb2-400d-a902-6b09ac329575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:18:00.314635 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d0fca-7fb2-400d-a902-6b09ac329575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:00.316234 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d0fca-7fb2-400d-a902-6b09ac329575 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:00.327965 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1310/2619] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:18:00.332069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a9bde-9287-4e9a-94d8-1de28dab411b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:00.341874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a9bde-9287-4e9a-94d8-1de28dab411b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:00.346728 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6965859-1857-49e2-8696-9702c4898510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:00.347537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965859-1857-49e2-8696-9702c4898510 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.347821 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965859-1857-49e2-8696-9702c4898510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.348098 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965859-1857-49e2-8696-9702c4898510 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.348819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6965859-1857-49e2-8696-9702c4898510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:00.350750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6965859-1857-49e2-8696-9702c4898510 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:00.374933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1310/2620] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:00 2022] POST /identity/v3/projects => generated 403 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:00.378883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d0fca-7fb2-400d-a902-6b09ac329575 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:00.389256 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d0fca-7fb2-400d-a902-6b09ac329575 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:00.444336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d1c02-0a36-4abc-8e57-d11ebe517e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:00.445116 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d1c02-0a36-4abc-8e57-d11ebe517e68 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.445401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d1c02-0a36-4abc-8e57-d11ebe517e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.445679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d1c02-0a36-4abc-8e57-d11ebe517e68 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.446360 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d1c02-0a36-4abc-8e57-d11ebe517e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:00.448311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d1c02-0a36-4abc-8e57-d11ebe517e68 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:00.471099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1311/2621] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:00 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:00.473347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6965859-1857-49e2-8696-9702c4898510 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:00.487660 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6965859-1857-49e2-8696-9702c4898510 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:00.493961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cc5a2-a9b2-4bbb-81c8-7bb8ea9315ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:00.494636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc5a2-a9b2-4bbb-81c8-7bb8ea9315ea admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.494925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc5a2-a9b2-4bbb-81c8-7bb8ea9315ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.495206 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cc5a2-a9b2-4bbb-81c8-7bb8ea9315ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.495947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cc5a2-a9b2-4bbb-81c8-7bb8ea9315ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:00.497595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cc5a2-a9b2-4bbb-81c8-7bb8ea9315ea admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:00.508392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1311/2622] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:00.512621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d1c02-0a36-4abc-8e57-d11ebe517e68 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:00.523323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d1c02-0a36-4abc-8e57-d11ebe517e68 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:00.528484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0131745-7fd2-49d3-8a29-43d926743480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:00.529135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0131745-7fd2-49d3-8a29-43d926743480 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.529424 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0131745-7fd2-49d3-8a29-43d926743480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.529705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0131745-7fd2-49d3-8a29-43d926743480 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.530438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0131745-7fd2-49d3-8a29-43d926743480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:00.532297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0131745-7fd2-49d3-8a29-43d926743480 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:00.550556 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1312/2623] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:00.551688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cc5a2-a9b2-4bbb-81c8-7bb8ea9315ea admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:00.562261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cc5a2-a9b2-4bbb-81c8-7bb8ea9315ea admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:00.567086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45024be-477b-40ff-b038-e40b17d1c041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:00.567891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45024be-477b-40ff-b038-e40b17d1c041 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.568169 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45024be-477b-40ff-b038-e40b17d1c041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.568478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45024be-477b-40ff-b038-e40b17d1c041 admin admin] PATH_INFO: `/v3/projects/b910e98ecb5f46d197f180c8385b2dd7/users/b437022b7ff94ca8a6a3eb222958f065/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.584818 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45024be-477b-40ff-b038-e40b17d1c041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b910e98ecb5f46d197f180c8385b2dd7, user_id=b437022b7ff94ca8a6a3eb222958f065, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:00.587448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45024be-477b-40ff-b038-e40b17d1c041 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:00.601783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1312/2624] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:00 2022] PUT /identity/v3/projects/b910e98ecb5f46d197f180c8385b2dd7/users/b437022b7ff94ca8a6a3eb222958f065/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:00.613112 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04690c07-00b6-4a43-a887-c2d78335a5e3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.613402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04690c07-00b6-4a43-a887-c2d78335a5e3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.613680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04690c07-00b6-4a43-a887-c2d78335a5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.640565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-04690c07-00b6-4a43-a887-c2d78335a5e3 None None] MFA Rules not processed for user `b437022b7ff94ca8a6a3eb222958f065`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:00.641761 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-04690c07-00b6-4a43-a887-c2d78335a5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:00.704563 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1313/2625] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:00.708974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45024be-477b-40ff-b038-e40b17d1c041 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:00.769150 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45024be-477b-40ff-b038-e40b17d1c041 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:00.773792 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc915142-4692-4531-9ed5-9619441a76fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:00.774433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915142-4692-4531-9ed5-9619441a76fd admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.774711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915142-4692-4531-9ed5-9619441a76fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.774982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915142-4692-4531-9ed5-9619441a76fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.775668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc915142-4692-4531-9ed5-9619441a76fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:00.777562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc915142-4692-4531-9ed5-9619441a76fd admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:00.801534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1313/2626] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:00 2022] POST /identity/v3/projects => generated 405 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:00.806019 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04690c07-00b6-4a43-a887-c2d78335a5e3 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:00.816503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04690c07-00b6-4a43-a887-c2d78335a5e3 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:00.876809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077db01-7371-4690-8950-78fe71e8d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:00.877414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077db01-7371-4690-8950-78fe71e8d15c admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.877699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077db01-7371-4690-8950-78fe71e8d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.878014 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077db01-7371-4690-8950-78fe71e8d15c admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.878700 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077db01-7371-4690-8950-78fe71e8d15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:00.881136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077db01-7371-4690-8950-78fe71e8d15c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:00.903634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1314/2627] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:00 2022] POST /identity/v3/users => generated 309 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:00.907716 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc915142-4692-4531-9ed5-9619441a76fd admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:00.918058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc915142-4692-4531-9ed5-9619441a76fd admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:00.922646 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16954938-bc86-41fe-be5a-0dc15dcf3950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:00.923296 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16954938-bc86-41fe-be5a-0dc15dcf3950 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.923583 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16954938-bc86-41fe-be5a-0dc15dcf3950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.923866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16954938-bc86-41fe-be5a-0dc15dcf3950 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.924629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16954938-bc86-41fe-be5a-0dc15dcf3950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:00.926229 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16954938-bc86-41fe-be5a-0dc15dcf3950 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:00.937385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1314/2628] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:18:00.941388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077db01-7371-4690-8950-78fe71e8d15c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:00.951868 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077db01-7371-4690-8950-78fe71e8d15c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:00.956543 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab4738-99dc-43f3-b944-5b034946e08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:00.957411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4738-99dc-43f3-b944-5b034946e08b admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:00.957689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4738-99dc-43f3-b944-5b034946e08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:00.957964 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4738-99dc-43f3-b944-5b034946e08b admin admin] PATH_INFO: `/v3/projects/d15e5308899140418d11e9e0bbebb5af/users/9d25ceb3ced5446e80edf510bbdc9e4a/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:00.972199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab4738-99dc-43f3-b944-5b034946e08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15e5308899140418d11e9e0bbebb5af, user_id=9d25ceb3ced5446e80edf510bbdc9e4a, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:00.974837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab4738-99dc-43f3-b944-5b034946e08b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:00.987139 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1315/2629] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:00 2022] PUT /identity/v3/projects/d15e5308899140418d11e9e0bbebb5af/users/9d25ceb3ced5446e80edf510bbdc9e4a/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:00.991741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16954938-bc86-41fe-be5a-0dc15dcf3950 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:01.001576 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16954938-bc86-41fe-be5a-0dc15dcf3950 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:01.057696 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaf3fe-e181-467e-ba84-af2483535c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:01.058355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaf3fe-e181-467e-ba84-af2483535c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:01.058634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaf3fe-e181-467e-ba84-af2483535c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:01.058906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaf3fe-e181-467e-ba84-af2483535c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:01.059617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbaf3fe-e181-467e-ba84-af2483535c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:01.061232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbaf3fe-e181-467e-ba84-af2483535c03 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:01.070809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1315/2630] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:01.074821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab4738-99dc-43f3-b944-5b034946e08b admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:01.085277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab4738-99dc-43f3-b944-5b034946e08b admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:01.089832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ed794-09eb-4d9d-b4f2-d5e15bd1a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:01.090695 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ed794-09eb-4d9d-b4f2-d5e15bd1a9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:01.090971 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ed794-09eb-4d9d-b4f2-d5e15bd1a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:01.091238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ed794-09eb-4d9d-b4f2-d5e15bd1a9e3 admin admin] PATH_INFO: `/v3/projects/d15e5308899140418d11e9e0bbebb5af/users/9d25ceb3ced5446e80edf510bbdc9e4a/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:01.093185 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ed794-09eb-4d9d-b4f2-d5e15bd1a9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15e5308899140418d11e9e0bbebb5af, user_id=9d25ceb3ced5446e80edf510bbdc9e4a, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:01.095782 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ed794-09eb-4d9d-b4f2-d5e15bd1a9e3 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:01.106046 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1316/2631] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:01 2022] PUT /identity/v3/projects/d15e5308899140418d11e9e0bbebb5af/users/9d25ceb3ced5446e80edf510bbdc9e4a/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:01.116433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c08994-ee81-46f8-8622-e7e1c719cab1 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:01.116922 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c08994-ee81-46f8-8622-e7e1c719cab1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:01.117220 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c08994-ee81-46f8-8622-e7e1c719cab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:01.143946 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-d6c08994-ee81-46f8-8622-e7e1c719cab1 None None] MFA Rules not processed for user `9d25ceb3ced5446e80edf510bbdc9e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:01.145093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d6c08994-ee81-46f8-8622-e7e1c719cab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:01.211465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1316/2632] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:01.222085 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ed794-09eb-4d9d-b4f2-d5e15bd1a9e3 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:01.223746 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-992ed794-09eb-4d9d-b4f2-d5e15bd1a9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:01.277931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ed794-09eb-4d9d-b4f2-d5e15bd1a9e3 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:01.281530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24b175-f4d5-4808-a2ac-f267b176cbea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:01.282149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b175-f4d5-4808-a2ac-f267b176cbea service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:01.282430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b175-f4d5-4808-a2ac-f267b176cbea service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:01.282705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b175-f4d5-4808-a2ac-f267b176cbea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:01.292220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24b175-f4d5-4808-a2ac-f267b176cbea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:01.293643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24b175-f4d5-4808-a2ac-f267b176cbea service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:01.302663 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1317/2633] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:01 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:03.394479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c08994-ee81-46f8-8622-e7e1c719cab1 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:03.454411 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c08994-ee81-46f8-8622-e7e1c719cab1 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:03.458816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:03.460459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:03.460741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:03.461012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] PATH_INFO: `/v3/users/b437022b7ff94ca8a6a3eb222958f065` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:03.462192 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b437022b7ff94ca8a6a3eb222958f065)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:03.464085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:03.512173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b437022b7ff94ca8a6a3eb222958f065'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:03.518719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b437022b7ff94ca8a6a3eb222958f065'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:03.526918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b437022b7ff94ca8a6a3eb222958f065'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:03.527739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b437022b7ff94ca8a6a3eb222958f065'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:03.528558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b437022b7ff94ca8a6a3eb222958f065'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:03.545895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1317/2634] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:03 2022] DELETE /identity/v3/users/b437022b7ff94ca8a6a3eb222958f065 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:03.550342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1d2c2-f1bf-4463-8965-ee4f2f596213 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:03.550789 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1d2c2-f1bf-4463-8965-ee4f2f596213 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:03.550916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1d2c2-f1bf-4463-8965-ee4f2f596213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:03.568033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-29a1d2c2-f1bf-4463-8965-ee4f2f596213 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:03.569894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-29a1d2c2-f1bf-4463-8965-ee4f2f596213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:03.625172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1318/2635] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:03.635305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:03.636746 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:03.691917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac497c41-c9fc-4341-9a6a-53dba7403bcd admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:03.696309 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930de85-32e1-47c6-9179-65208bdc6808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:03.696950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930de85-32e1-47c6-9179-65208bdc6808 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:03.697236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930de85-32e1-47c6-9179-65208bdc6808 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:03.697513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930de85-32e1-47c6-9179-65208bdc6808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:03.706785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930de85-32e1-47c6-9179-65208bdc6808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:03.708147 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930de85-32e1-47c6-9179-65208bdc6808 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:03.717399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1318/2636] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:04.063091 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1d2c2-f1bf-4463-8965-ee4f2f596213 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:04.064633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-29a1d2c2-f1bf-4463-8965-ee4f2f596213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:04.078327 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1d2c2-f1bf-4463-8965-ee4f2f596213 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:04.083422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:04.084569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:04.084962 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:04.085308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] PATH_INFO: `/v3/projects/b910e98ecb5f46d197f180c8385b2dd7` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:04.086565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b910e98ecb5f46d197f180c8385b2dd7)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:04.088626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:04.134809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b910e98ecb5f46d197f180c8385b2dd7', 'request_id': 'req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.140743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b910e98ecb5f46d197f180c8385b2dd7', 'request_id': 'req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.146020 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b910e98ecb5f46d197f180c8385b2dd7', 'request_id': 'req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.157814 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] The token cache is being invalidate because project b910e98ecb5f46d197f180c8385b2dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:04.158110 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.158741 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.160317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1319/2637] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:04 2022] DELETE /identity/v3/projects/b910e98ecb5f46d197f180c8385b2dd7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:18:04.164768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930de85-32e1-47c6-9179-65208bdc6808 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:04.174128 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930de85-32e1-47c6-9179-65208bdc6808 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:04.234287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:04.235093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:04.235371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:04.235642 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] PATH_INFO: `/v3/users/9d25ceb3ced5446e80edf510bbdc9e4a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:04.236907 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d25ceb3ced5446e80edf510bbdc9e4a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:04.238923 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:04.290945 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d25ceb3ced5446e80edf510bbdc9e4a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.298183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d25ceb3ced5446e80edf510bbdc9e4a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.306994 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d25ceb3ced5446e80edf510bbdc9e4a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.307731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d25ceb3ced5446e80edf510bbdc9e4a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.308423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d25ceb3ced5446e80edf510bbdc9e4a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.327118 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1319/2638] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:04 2022] DELETE /identity/v3/users/9d25ceb3ced5446e80edf510bbdc9e4a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:04.538737 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:04.540280 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:04.621355 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:04.623300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:04.624352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9712d6-8865-4d2b-b72b-47f7ecf1e42f admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:04.690997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd1867-a14f-40b0-b8ab-e39791ff3b9b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:04.694512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474fa9b-185d-4231-b6e2-9c01e114bb6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:04.695315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fa9b-185d-4231-b6e2-9c01e114bb6c service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:04.695607 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fa9b-185d-4231-b6e2-9c01e114bb6c service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:04.695884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fa9b-185d-4231-b6e2-9c01e114bb6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:04.696745 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:04.697596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:04.697708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-6474fa9b-185d-4231-b6e2-9c01e114bb6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:04.697877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:04.698151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] PATH_INFO: `/v3/projects/d15e5308899140418d11e9e0bbebb5af` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:04.699323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15e5308899140418d11e9e0bbebb5af)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:04.701488 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:04.710458 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474fa9b-185d-4231-b6e2-9c01e114bb6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:04.712049 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474fa9b-185d-4231-b6e2-9c01e114bb6c service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:04.722422 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1320/2639] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:04.749989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15e5308899140418d11e9e0bbebb5af', 'request_id': 'req-90c48ec7-7660-4964-9568-17e945f36bdf'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.757635 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15e5308899140418d11e9e0bbebb5af', 'request_id': 'req-90c48ec7-7660-4964-9568-17e945f36bdf'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.764025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15e5308899140418d11e9e0bbebb5af', 'request_id': 'req-90c48ec7-7660-4964-9568-17e945f36bdf'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.774110 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] The token cache is being invalidate because project d15e5308899140418d11e9e0bbebb5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:04.774391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.775019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-90c48ec7-7660-4964-9568-17e945f36bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:04.776585 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1320/2640] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:04 2022] DELETE /identity/v3/projects/d15e5308899140418d11e9e0bbebb5af => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:04.781370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba90fa-0986-4e6e-9995-0a89ca4fb9a6 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:04.781712 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba90fa-0986-4e6e-9995-0a89ca4fb9a6 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:04.781991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba90fa-0986-4e6e-9995-0a89ca4fb9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:04.800631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ebba90fa-0986-4e6e-9995-0a89ca4fb9a6 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:04.801849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ebba90fa-0986-4e6e-9995-0a89ca4fb9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:04.862065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1321/2641] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:04.870270 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096aeb2-0743-4aeb-9b04-733556aff42b None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:04.870560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096aeb2-0743-4aeb-9b04-733556aff42b None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:04.870838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096aeb2-0743-4aeb-9b04-733556aff42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:04.888997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-0096aeb2-0743-4aeb-9b04-733556aff42b None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:04.890235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-0096aeb2-0743-4aeb-9b04-733556aff42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:04.898527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1321/2642] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:04.902666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba90fa-0986-4e6e-9995-0a89ca4fb9a6 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:04.914024 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba90fa-0986-4e6e-9995-0a89ca4fb9a6 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:04.918715 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1c70d-896f-4241-96fd-cde6f62f6e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:04.919401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1c70d-896f-4241-96fd-cde6f62f6e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:04.919682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1c70d-896f-4241-96fd-cde6f62f6e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:04.919954 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1c70d-896f-4241-96fd-cde6f62f6e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:04.920719 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1c70d-896f-4241-96fd-cde6f62f6e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:18:04.921027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1c70d-896f-4241-96fd-cde6f62f6e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:04.922613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1c70d-896f-4241-96fd-cde6f62f6e38 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:04.934964 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1322/2643] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:18:04.939198 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096aeb2-0743-4aeb-9b04-733556aff42b None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:04.948611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096aeb2-0743-4aeb-9b04-733556aff42b None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:04.953628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337fc48-6b0c-415b-b69c-de33b8d3d776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:04.954360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337fc48-6b0c-415b-b69c-de33b8d3d776 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:04.954714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337fc48-6b0c-415b-b69c-de33b8d3d776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:04.955062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337fc48-6b0c-415b-b69c-de33b8d3d776 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:04.955822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337fc48-6b0c-415b-b69c-de33b8d3d776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:04.957878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337fc48-6b0c-415b-b69c-de33b8d3d776 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:04.987239 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1322/2644] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:04 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:18:04.988889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1c70d-896f-4241-96fd-cde6f62f6e38 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:04.998850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1c70d-896f-4241-96fd-cde6f62f6e38 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:05.052740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a68e0-fc88-4d8e-b83d-cf00344ce93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:05.054009 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a68e0-fc88-4d8e-b83d-cf00344ce93a admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.054291 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a68e0-fc88-4d8e-b83d-cf00344ce93a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.054560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a68e0-fc88-4d8e-b83d-cf00344ce93a admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.055229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a68e0-fc88-4d8e-b83d-cf00344ce93a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:05.057157 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a68e0-fc88-4d8e-b83d-cf00344ce93a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:05.076381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1323/2645] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:04 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:05.079932 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337fc48-6b0c-415b-b69c-de33b8d3d776 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:05.090530 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337fc48-6b0c-415b-b69c-de33b8d3d776 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:05.095208 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b30ba-0172-4570-83f0-c383e8416d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:05.095870 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b30ba-0172-4570-83f0-c383e8416d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.096152 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b30ba-0172-4570-83f0-c383e8416d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.096463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b30ba-0172-4570-83f0-c383e8416d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.097222 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b30ba-0172-4570-83f0-c383e8416d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:05.098828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b30ba-0172-4570-83f0-c383e8416d7c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:05.109646 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1323/2646] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:05.113618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a68e0-fc88-4d8e-b83d-cf00344ce93a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:05.124125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a68e0-fc88-4d8e-b83d-cf00344ce93a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:05.129274 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a911975-3c74-44f5-8805-788df8d6352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:05.130065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a911975-3c74-44f5-8805-788df8d6352d admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.130472 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a911975-3c74-44f5-8805-788df8d6352d admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.130744 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a911975-3c74-44f5-8805-788df8d6352d admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.132631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a911975-3c74-44f5-8805-788df8d6352d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:05.134250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a911975-3c74-44f5-8805-788df8d6352d admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:05.144657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1324/2647] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:05.149356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b30ba-0172-4570-83f0-c383e8416d7c admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:05.159409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b30ba-0172-4570-83f0-c383e8416d7c admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:05.164979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffed60-0b05-4457-a99e-cf03fb9f278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:05.165863 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffed60-0b05-4457-a99e-cf03fb9f278c admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.166151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffed60-0b05-4457-a99e-cf03fb9f278c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.166429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffed60-0b05-4457-a99e-cf03fb9f278c admin admin] PATH_INFO: `/v3/projects/e1796d32e63748e997e2332f39779b5a/users/c7eaa7b682c6421886a3db442224bd33/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.181300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffed60-0b05-4457-a99e-cf03fb9f278c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1796d32e63748e997e2332f39779b5a, user_id=c7eaa7b682c6421886a3db442224bd33, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:05.183954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffed60-0b05-4457-a99e-cf03fb9f278c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:05.197672 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1324/2648] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:05 2022] PUT /identity/v3/projects/e1796d32e63748e997e2332f39779b5a/users/c7eaa7b682c6421886a3db442224bd33/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:18:05.209799 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b697522-fa25-41a9-af67-dd25503f08c9 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.210568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b697522-fa25-41a9-af67-dd25503f08c9 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.210568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b697522-fa25-41a9-af67-dd25503f08c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.245546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-5b697522-fa25-41a9-af67-dd25503f08c9 None None] MFA Rules not processed for user `c7eaa7b682c6421886a3db442224bd33`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:05.246751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5b697522-fa25-41a9-af67-dd25503f08c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:05.313898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1325/2649] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:05.318149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffed60-0b05-4457-a99e-cf03fb9f278c admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:05.384761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffed60-0b05-4457-a99e-cf03fb9f278c admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:05.389370 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598cca4-514e-4389-a8e0-76bc18dc8ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:05.390018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598cca4-514e-4389-a8e0-76bc18dc8ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.390298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598cca4-514e-4389-a8e0-76bc18dc8ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.390571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598cca4-514e-4389-a8e0-76bc18dc8ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.391261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598cca4-514e-4389-a8e0-76bc18dc8ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:05.393236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598cca4-514e-4389-a8e0-76bc18dc8ca0 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:05.419073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1325/2650] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:05 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:05.423154 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b697522-fa25-41a9-af67-dd25503f08c9 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:05.434207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b697522-fa25-41a9-af67-dd25503f08c9 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:05.488790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e31941-e22d-42b0-bc19-17a72edffc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:05.489455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31941-e22d-42b0-bc19-17a72edffc1c admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.489740 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31941-e22d-42b0-bc19-17a72edffc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.490017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e31941-e22d-42b0-bc19-17a72edffc1c admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.490918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e31941-e22d-42b0-bc19-17a72edffc1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:05.492919 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e31941-e22d-42b0-bc19-17a72edffc1c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:05.513680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1326/2651] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:05 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:05.517838 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598cca4-514e-4389-a8e0-76bc18dc8ca0 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:05.528554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598cca4-514e-4389-a8e0-76bc18dc8ca0 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:05.533588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50502030-a7df-4135-bee8-8c474cd1388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:05.534267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50502030-a7df-4135-bee8-8c474cd1388d admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.534550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50502030-a7df-4135-bee8-8c474cd1388d admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.534825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50502030-a7df-4135-bee8-8c474cd1388d admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.535565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50502030-a7df-4135-bee8-8c474cd1388d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:05.537213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50502030-a7df-4135-bee8-8c474cd1388d admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:05.548039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1326/2652] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:05.552760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e31941-e22d-42b0-bc19-17a72edffc1c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:05.562831 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e31941-e22d-42b0-bc19-17a72edffc1c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:05.567470 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc0d0f-2575-493d-97d9-3bbab6a669cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:05.568363 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc0d0f-2575-493d-97d9-3bbab6a669cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.569295 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc0d0f-2575-493d-97d9-3bbab6a669cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.569573 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc0d0f-2575-493d-97d9-3bbab6a669cb admin admin] PATH_INFO: `/v3/projects/a663f7ad35ba4397aaac6ce4afb84006/users/873fe81e92754d379dafffe3e0c13c30/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.586083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc0d0f-2575-493d-97d9-3bbab6a669cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a663f7ad35ba4397aaac6ce4afb84006, user_id=873fe81e92754d379dafffe3e0c13c30, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:05.588018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc0d0f-2575-493d-97d9-3bbab6a669cb admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:05.601136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1327/2653] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:05 2022] PUT /identity/v3/projects/a663f7ad35ba4397aaac6ce4afb84006/users/873fe81e92754d379dafffe3e0c13c30/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:18:05.605334 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50502030-a7df-4135-bee8-8c474cd1388d admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:05.615312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50502030-a7df-4135-bee8-8c474cd1388d admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:05.669698 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915cdd-5b6f-481c-9a47-3ef21dd6b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:05.670347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915cdd-5b6f-481c-9a47-3ef21dd6b815 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.670624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915cdd-5b6f-481c-9a47-3ef21dd6b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.670898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915cdd-5b6f-481c-9a47-3ef21dd6b815 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.671613 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80915cdd-5b6f-481c-9a47-3ef21dd6b815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:05.673222 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80915cdd-5b6f-481c-9a47-3ef21dd6b815 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:05.682659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1327/2654] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:05.686753 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc0d0f-2575-493d-97d9-3bbab6a669cb admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:05.697443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc0d0f-2575-493d-97d9-3bbab6a669cb admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:05.702371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fc380-6310-4327-8b12-6b9e3dc64035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:05.703242 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc380-6310-4327-8b12-6b9e3dc64035 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.703525 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc380-6310-4327-8b12-6b9e3dc64035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.703800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fc380-6310-4327-8b12-6b9e3dc64035 admin admin] PATH_INFO: `/v3/projects/a663f7ad35ba4397aaac6ce4afb84006/users/873fe81e92754d379dafffe3e0c13c30/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.705812 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fc380-6310-4327-8b12-6b9e3dc64035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a663f7ad35ba4397aaac6ce4afb84006, user_id=873fe81e92754d379dafffe3e0c13c30, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:05.708497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fc380-6310-4327-8b12-6b9e3dc64035 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:05.719155 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1328/2655] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:05 2022] PUT /identity/v3/projects/a663f7ad35ba4397aaac6ce4afb84006/users/873fe81e92754d379dafffe3e0c13c30/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:05.729391 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1ca5-7219-40f7-bf8f-98e77880ce96 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.729689 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1ca5-7219-40f7-bf8f-98e77880ce96 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.729972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1ca5-7219-40f7-bf8f-98e77880ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.755675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-701a1ca5-7219-40f7-bf8f-98e77880ce96 None None] MFA Rules not processed for user `873fe81e92754d379dafffe3e0c13c30`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:05.757332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-701a1ca5-7219-40f7-bf8f-98e77880ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:05.822435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1328/2656] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:05.833842 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fc380-6310-4327-8b12-6b9e3dc64035 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:05.836350 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-662fc380-6310-4327-8b12-6b9e3dc64035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:05.890978 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fc380-6310-4327-8b12-6b9e3dc64035 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:05.894547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7aaa8-1f3f-4b54-a919-9928aab4c19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:05.895172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7aaa8-1f3f-4b54-a919-9928aab4c19c service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:05.895451 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7aaa8-1f3f-4b54-a919-9928aab4c19c service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:05.895720 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7aaa8-1f3f-4b54-a919-9928aab4c19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:05.904444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7aaa8-1f3f-4b54-a919-9928aab4c19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:05.905864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7aaa8-1f3f-4b54-a919-9928aab4c19c service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:05.914897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1329/2657] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:05.987668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1ca5-7219-40f7-bf8f-98e77880ce96 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:05.998096 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1ca5-7219-40f7-bf8f-98e77880ce96 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:06.001714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f050ba-46d4-4cd2-a7e2-d854fe47f526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:06.002349 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f050ba-46d4-4cd2-a7e2-d854fe47f526 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:06.002632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f050ba-46d4-4cd2-a7e2-d854fe47f526 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:06.002919 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f050ba-46d4-4cd2-a7e2-d854fe47f526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:06.057742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f050ba-46d4-4cd2-a7e2-d854fe47f526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:06.059090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f050ba-46d4-4cd2-a7e2-d854fe47f526 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:06.067643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1329/2658] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:09.009504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7aaa8-1f3f-4b54-a919-9928aab4c19c service cinder] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:09.010901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-46f7aaa8-1f3f-4b54-a919-9928aab4c19c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:09.072748 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7aaa8-1f3f-4b54-a919-9928aab4c19c service cinder] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:09.077351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:09.078201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:09.078483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:09.078757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] PATH_INFO: `/v3/users/9d9a9d743c344a998aa1049876cba272` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:09.079911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9a9d743c344a998aa1049876cba272)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:09.081849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:09.125795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9a9d743c344a998aa1049876cba272'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.126441 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9a9d743c344a998aa1049876cba272'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.133550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9a9d743c344a998aa1049876cba272'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.140357 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9a9d743c344a998aa1049876cba272'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.140981 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9a9d743c344a998aa1049876cba272'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.157716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1330/2659] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:09 2022] DELETE /identity/v3/users/9d9a9d743c344a998aa1049876cba272 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:09.162882 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824e76-ad17-4055-a2fd-552521a3b4d4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:09.163508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824e76-ad17-4055-a2fd-552521a3b4d4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:09.163508 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6824e76-ad17-4055-a2fd-552521a3b4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:09.179712 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e6824e76-ad17-4055-a2fd-552521a3b4d4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:09.180952 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e6824e76-ad17-4055-a2fd-552521a3b4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:09.237083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1330/2660] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:09.246546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:09.247918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:09.302315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90569e-3c02-4cc0-973d-60f8ca206186 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:09.305930 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad13a9d-573f-4fe0-9a57-3d8e4b333fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:09.306561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad13a9d-573f-4fe0-9a57-3d8e4b333fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:09.306842 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad13a9d-573f-4fe0-9a57-3d8e4b333fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:09.307117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad13a9d-573f-4fe0-9a57-3d8e4b333fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:09.315763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad13a9d-573f-4fe0-9a57-3d8e4b333fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:09.317214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad13a9d-573f-4fe0-9a57-3d8e4b333fe6 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:09.326997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1331/2661] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:09.583766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6824e76-ad17-4055-a2fd-552521a3b4d4 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:09.585924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e6824e76-ad17-4055-a2fd-552521a3b4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:09.598539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6824e76-ad17-4055-a2fd-552521a3b4d4 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:09.603995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:09.604895 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:09.605181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:09.605450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] PATH_INFO: `/v3/projects/ae9f1c5826d944dc90b136eff44f3914` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:09.606649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9f1c5826d944dc90b136eff44f3914)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:09.608596 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:09.654589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9f1c5826d944dc90b136eff44f3914', 'request_id': 'req-5832dc96-07e6-4e8b-824b-cd53570dd365'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.661605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9f1c5826d944dc90b136eff44f3914', 'request_id': 'req-5832dc96-07e6-4e8b-824b-cd53570dd365'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.667775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9f1c5826d944dc90b136eff44f3914', 'request_id': 'req-5832dc96-07e6-4e8b-824b-cd53570dd365'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.677628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] The token cache is being invalidate because project ae9f1c5826d944dc90b136eff44f3914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:09.678418 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.679017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.680581 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1331/2662] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:09 2022] DELETE /identity/v3/projects/ae9f1c5826d944dc90b136eff44f3914 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:09.684501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad13a9d-573f-4fe0-9a57-3d8e4b333fe6 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:09.694379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad13a9d-573f-4fe0-9a57-3d8e4b333fe6 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:09.749001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c406ef7-5337-4a76-8301-0d32bb99873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:09.749860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c406ef7-5337-4a76-8301-0d32bb99873e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:09.750140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c406ef7-5337-4a76-8301-0d32bb99873e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:09.750412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c406ef7-5337-4a76-8301-0d32bb99873e admin admin] PATH_INFO: `/v3/users/ff1cd3b2650d463d9601f1eb4365edaf` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:09.751595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c406ef7-5337-4a76-8301-0d32bb99873e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1cd3b2650d463d9601f1eb4365edaf)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:09.753708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c406ef7-5337-4a76-8301-0d32bb99873e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:09.797888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9c406ef7-5337-4a76-8301-0d32bb99873e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1cd3b2650d463d9601f1eb4365edaf'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.798454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9c406ef7-5337-4a76-8301-0d32bb99873e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1cd3b2650d463d9601f1eb4365edaf'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.805567 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9c406ef7-5337-4a76-8301-0d32bb99873e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1cd3b2650d463d9601f1eb4365edaf'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.812528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9c406ef7-5337-4a76-8301-0d32bb99873e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1cd3b2650d463d9601f1eb4365edaf'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.813143 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9c406ef7-5337-4a76-8301-0d32bb99873e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1cd3b2650d463d9601f1eb4365edaf'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:09.830763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1332/2663] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:09 2022] DELETE /identity/v3/users/ff1cd3b2650d463d9601f1eb4365edaf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:10.150784 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:10.152232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:10.165565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832dc96-07e6-4e8b-824b-cd53570dd365 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:10.223211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:10.224066 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.224385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.224789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] PATH_INFO: `/v3/projects/c1aa0e170b0f4db5918bc8dafe724373` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.226140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1aa0e170b0f4db5918bc8dafe724373)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:10.228048 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:10.274138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1aa0e170b0f4db5918bc8dafe724373', 'request_id': 'req-91e34a47-00b3-4a29-b435-3cab050acb0e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:10.280874 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1aa0e170b0f4db5918bc8dafe724373', 'request_id': 'req-91e34a47-00b3-4a29-b435-3cab050acb0e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:10.287738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1aa0e170b0f4db5918bc8dafe724373', 'request_id': 'req-91e34a47-00b3-4a29-b435-3cab050acb0e'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:10.298366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] The token cache is being invalidate because project c1aa0e170b0f4db5918bc8dafe724373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:10.298648 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:10.299287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-91e34a47-00b3-4a29-b435-3cab050acb0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:10.300852 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1332/2664] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:10 2022] DELETE /identity/v3/projects/c1aa0e170b0f4db5918bc8dafe724373 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:10.306003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6088a-332b-46e7-a45b-965c25cbdefb None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.306508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6088a-332b-46e7-a45b-965c25cbdefb None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.306628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6088a-332b-46e7-a45b-965c25cbdefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.324643 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7aa6088a-332b-46e7-a45b-965c25cbdefb None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:10.325997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7aa6088a-332b-46e7-a45b-965c25cbdefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:10.385051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1333/2665] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:10.392758 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1c7e-bfce-47dc-984c-cb39b47dee9a None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.393044 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1c7e-bfce-47dc-984c-cb39b47dee9a None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.393321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1c7e-bfce-47dc-984c-cb39b47dee9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.412889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e3ed1c7e-bfce-47dc-984c-cb39b47dee9a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:10.414434 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e3ed1c7e-bfce-47dc-984c-cb39b47dee9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:10.422276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1333/2666] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:10.426353 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6088a-332b-46e7-a45b-965c25cbdefb None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:10.436480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6088a-332b-46e7-a45b-965c25cbdefb None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:10.441003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0618900-6591-47cf-99e1-b3a3334e2a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:10.441654 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0618900-6591-47cf-99e1-b3a3334e2a29 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.441941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0618900-6591-47cf-99e1-b3a3334e2a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.442222 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0618900-6591-47cf-99e1-b3a3334e2a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.442951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0618900-6591-47cf-99e1-b3a3334e2a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:18:10.443368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0618900-6591-47cf-99e1-b3a3334e2a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:10.445501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0618900-6591-47cf-99e1-b3a3334e2a29 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:10.457037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1334/2667] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:18:10.461104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed1c7e-bfce-47dc-984c-cb39b47dee9a None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:10.470121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed1c7e-bfce-47dc-984c-cb39b47dee9a None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:10.474801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efd9b4-4d37-47d9-9527-d19286aa0e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:10.475435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efd9b4-4d37-47d9-9527-d19286aa0e87 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.475720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efd9b4-4d37-47d9-9527-d19286aa0e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.475997 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efd9b4-4d37-47d9-9527-d19286aa0e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.476725 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efd9b4-4d37-47d9-9527-d19286aa0e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:10.478612 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efd9b4-4d37-47d9-9527-d19286aa0e87 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:10.503748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1334/2668] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:10 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:18:10.508394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0618900-6591-47cf-99e1-b3a3334e2a29 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:10.518460 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0618900-6591-47cf-99e1-b3a3334e2a29 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:10.576244 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1c6d6-3dde-460a-8ecd-2b44876e293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:10.576829 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1c6d6-3dde-460a-8ecd-2b44876e293d admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.577132 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1c6d6-3dde-460a-8ecd-2b44876e293d admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.577387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1c6d6-3dde-460a-8ecd-2b44876e293d admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.578081 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1c6d6-3dde-460a-8ecd-2b44876e293d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:10.579968 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1c6d6-3dde-460a-8ecd-2b44876e293d admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:10.599931 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1335/2669] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:10 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:10.604688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efd9b4-4d37-47d9-9527-d19286aa0e87 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:10.614991 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efd9b4-4d37-47d9-9527-d19286aa0e87 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:10.620097 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5802c-318b-419f-b99e-aadc24c01912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:10.620772 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5802c-318b-419f-b99e-aadc24c01912 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.621051 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5802c-318b-419f-b99e-aadc24c01912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.621324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5802c-318b-419f-b99e-aadc24c01912 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.622041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5802c-318b-419f-b99e-aadc24c01912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:10.623612 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5802c-318b-419f-b99e-aadc24c01912 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:10.634304 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1335/2670] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:10.638223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1c6d6-3dde-460a-8ecd-2b44876e293d admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:10.648133 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1c6d6-3dde-460a-8ecd-2b44876e293d admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:10.652811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bdaa9-f4c7-45ac-b3f9-a15d5bffc64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:10.653463 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bdaa9-f4c7-45ac-b3f9-a15d5bffc64e admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.653747 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bdaa9-f4c7-45ac-b3f9-a15d5bffc64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.654023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bdaa9-f4c7-45ac-b3f9-a15d5bffc64e admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.654745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bdaa9-f4c7-45ac-b3f9-a15d5bffc64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:10.656364 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bdaa9-f4c7-45ac-b3f9-a15d5bffc64e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:10.666089 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1336/2671] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:10.669986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5802c-318b-419f-b99e-aadc24c01912 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:10.680170 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5802c-318b-419f-b99e-aadc24c01912 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:10.684724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5566fe-b971-488b-9ced-889370caadd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:10.685578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5566fe-b971-488b-9ced-889370caadd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.685855 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5566fe-b971-488b-9ced-889370caadd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.686131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5566fe-b971-488b-9ced-889370caadd9 admin admin] PATH_INFO: `/v3/projects/a145143c34c54e6ba1d4453c10d19a63/users/c859c00d8e2e4803bb3c737a709079b0/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.700832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5566fe-b971-488b-9ced-889370caadd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a145143c34c54e6ba1d4453c10d19a63, user_id=c859c00d8e2e4803bb3c737a709079b0, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:10.703433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5566fe-b971-488b-9ced-889370caadd9 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:10.715988 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1336/2672] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:10 2022] PUT /identity/v3/projects/a145143c34c54e6ba1d4453c10d19a63/users/c859c00d8e2e4803bb3c737a709079b0/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:10.727174 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971199-b798-4b52-9573-8ef08d98a8d1 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.727473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971199-b798-4b52-9573-8ef08d98a8d1 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.727755 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971199-b798-4b52-9573-8ef08d98a8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.754135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-9a971199-b798-4b52-9573-8ef08d98a8d1 None None] MFA Rules not processed for user `c859c00d8e2e4803bb3c737a709079b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:10.755317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9a971199-b798-4b52-9573-8ef08d98a8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:10.816730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1337/2673] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:10.821263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5566fe-b971-488b-9ced-889370caadd9 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:10.883486 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5566fe-b971-488b-9ced-889370caadd9 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:10.888127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bbbcd-0d06-4db3-b7f3-2b875fe8d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:10.888811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bbbcd-0d06-4db3-b7f3-2b875fe8d766 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.889228 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bbbcd-0d06-4db3-b7f3-2b875fe8d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.889402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bbbcd-0d06-4db3-b7f3-2b875fe8d766 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.890175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bbbcd-0d06-4db3-b7f3-2b875fe8d766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:10.892269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bbbcd-0d06-4db3-b7f3-2b875fe8d766 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:10.917306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1337/2674] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:10 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:18:10.921331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971199-b798-4b52-9573-8ef08d98a8d1 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:10.933066 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971199-b798-4b52-9573-8ef08d98a8d1 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:10.986809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aead0-842b-446b-b3eb-03bee1cd54ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:10.987465 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aead0-842b-446b-b3eb-03bee1cd54ea admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:10.987745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aead0-842b-446b-b3eb-03bee1cd54ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:10.988017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aead0-842b-446b-b3eb-03bee1cd54ea admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:10.988735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aead0-842b-446b-b3eb-03bee1cd54ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:10.991265 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aead0-842b-446b-b3eb-03bee1cd54ea admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:11.010012 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1338/2675] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:10 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:11.014011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bbbcd-0d06-4db3-b7f3-2b875fe8d766 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:11.023971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bbbcd-0d06-4db3-b7f3-2b875fe8d766 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:11.028789 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3a95-a296-40f8-b6de-c804eecb1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:11.029445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3a95-a296-40f8-b6de-c804eecb1cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:11.029732 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3a95-a296-40f8-b6de-c804eecb1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:11.030002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3a95-a296-40f8-b6de-c804eecb1cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:11.030731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f3a95-a296-40f8-b6de-c804eecb1cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:11.032464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f3a95-a296-40f8-b6de-c804eecb1cbe admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:11.044071 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1338/2676] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:11.048204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aead0-842b-446b-b3eb-03bee1cd54ea admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:11.058637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aead0-842b-446b-b3eb-03bee1cd54ea admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:11.063135 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac34013-8dba-4a06-9770-641734cc9cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:11.064001 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac34013-8dba-4a06-9770-641734cc9cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:11.064320 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac34013-8dba-4a06-9770-641734cc9cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:11.064610 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac34013-8dba-4a06-9770-641734cc9cd0 admin admin] PATH_INFO: `/v3/projects/b22d0623051a409f8da0fbed275ffc1f/users/727e81f0d2ed4d44aeb80fa70ec533d0/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:11.079403 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac34013-8dba-4a06-9770-641734cc9cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22d0623051a409f8da0fbed275ffc1f, user_id=727e81f0d2ed4d44aeb80fa70ec533d0, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:11.082067 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac34013-8dba-4a06-9770-641734cc9cd0 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:11.094497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1339/2677] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:11 2022] PUT /identity/v3/projects/b22d0623051a409f8da0fbed275ffc1f/users/727e81f0d2ed4d44aeb80fa70ec533d0/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:18:11.098330 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3a95-a296-40f8-b6de-c804eecb1cbe admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:11.109211 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3a95-a296-40f8-b6de-c804eecb1cbe admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:11.165752 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60d2ae-a0bc-40ca-98da-100ab6f84a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:11.166455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60d2ae-a0bc-40ca-98da-100ab6f84a22 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:11.166689 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60d2ae-a0bc-40ca-98da-100ab6f84a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:11.166962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60d2ae-a0bc-40ca-98da-100ab6f84a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:11.167692 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60d2ae-a0bc-40ca-98da-100ab6f84a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:11.169319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60d2ae-a0bc-40ca-98da-100ab6f84a22 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:11.179121 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1339/2678] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:11.183228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac34013-8dba-4a06-9770-641734cc9cd0 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:11.193186 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac34013-8dba-4a06-9770-641734cc9cd0 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:11.198031 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2931-875b-4178-bf99-5832f4eed167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:11.198922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2931-875b-4178-bf99-5832f4eed167 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:11.199206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2931-875b-4178-bf99-5832f4eed167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:11.199483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2931-875b-4178-bf99-5832f4eed167 admin admin] PATH_INFO: `/v3/projects/b22d0623051a409f8da0fbed275ffc1f/users/727e81f0d2ed4d44aeb80fa70ec533d0/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:11.201758 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d2931-875b-4178-bf99-5832f4eed167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22d0623051a409f8da0fbed275ffc1f, user_id=727e81f0d2ed4d44aeb80fa70ec533d0, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:11.204468 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d2931-875b-4178-bf99-5832f4eed167 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:11.215842 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1340/2679] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:11 2022] PUT /identity/v3/projects/b22d0623051a409f8da0fbed275ffc1f/users/727e81f0d2ed4d44aeb80fa70ec533d0/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:11.225989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902513fa-3139-4436-a875-d0dc4301bfd1 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:11.226364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902513fa-3139-4436-a875-d0dc4301bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:11.227233 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902513fa-3139-4436-a875-d0dc4301bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:11.254352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-902513fa-3139-4436-a875-d0dc4301bfd1 None None] MFA Rules not processed for user `727e81f0d2ed4d44aeb80fa70ec533d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:11.255533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-902513fa-3139-4436-a875-d0dc4301bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:11.322490 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1340/2680] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:11.334471 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2931-875b-4178-bf99-5832f4eed167 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:11.336476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b38d2931-875b-4178-bf99-5832f4eed167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:11.390376 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2931-875b-4178-bf99-5832f4eed167 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:11.393861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc265893-3f96-41dc-853e-aee792ca6b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:11.394494 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265893-3f96-41dc-853e-aee792ca6b2c service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:11.394774 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265893-3f96-41dc-853e-aee792ca6b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:11.395048 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc265893-3f96-41dc-853e-aee792ca6b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:11.404357 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc265893-3f96-41dc-853e-aee792ca6b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:11.405768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc265893-3f96-41dc-853e-aee792ca6b2c service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:11.415723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1341/2681] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:11.479509 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902513fa-3139-4436-a875-d0dc4301bfd1 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:11.543068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902513fa-3139-4436-a875-d0dc4301bfd1 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:11.547649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:11.548560 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:11.548848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:11.549223 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] PATH_INFO: `/v3/users/c859c00d8e2e4803bb3c737a709079b0` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:11.550446 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c859c00d8e2e4803bb3c737a709079b0)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:11.552416 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:11.598489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c859c00d8e2e4803bb3c737a709079b0'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:11.605215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c859c00d8e2e4803bb3c737a709079b0'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:11.611883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c859c00d8e2e4803bb3c737a709079b0'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:11.612503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c859c00d8e2e4803bb3c737a709079b0'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:11.613109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c859c00d8e2e4803bb3c737a709079b0'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:11.629816 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1341/2682] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:11 2022] DELETE /identity/v3/users/c859c00d8e2e4803bb3c737a709079b0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:11.634751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a420c0-2487-4d40-b670-023a2e5ec5c2 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:11.635043 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a420c0-2487-4d40-b670-023a2e5ec5c2 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:11.635321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a420c0-2487-4d40-b670-023a2e5ec5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:11.653674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-05a420c0-2487-4d40-b670-023a2e5ec5c2 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:11.654873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-05a420c0-2487-4d40-b670-023a2e5ec5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:11.712102 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1342/2683] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:11.721609 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:11.722995 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:11.779832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ab246-44c6-4e66-b4ab-95abd97e92db admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:11.783505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677716a4-aa99-48df-ac50-94279efd340e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:11.784146 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677716a4-aa99-48df-ac50-94279efd340e service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:11.784462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677716a4-aa99-48df-ac50-94279efd340e service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:11.784744 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677716a4-aa99-48df-ac50-94279efd340e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:11.793680 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677716a4-aa99-48df-ac50-94279efd340e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:11.795104 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677716a4-aa99-48df-ac50-94279efd340e service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:11.804439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1342/2684] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:12.064856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a420c0-2487-4d40-b670-023a2e5ec5c2 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:12.066318 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-05a420c0-2487-4d40-b670-023a2e5ec5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:12.081276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a420c0-2487-4d40-b670-023a2e5ec5c2 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:12.086405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:12.087386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:12.087666 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:12.087946 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] PATH_INFO: `/v3/projects/a145143c34c54e6ba1d4453c10d19a63` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:12.089329 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a145143c34c54e6ba1d4453c10d19a63)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:12.091151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:12.136843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a145143c34c54e6ba1d4453c10d19a63', 'request_id': 'req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.142864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a145143c34c54e6ba1d4453c10d19a63', 'request_id': 'req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.148910 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a145143c34c54e6ba1d4453c10d19a63', 'request_id': 'req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.160230 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] The token cache is being invalidate because project a145143c34c54e6ba1d4453c10d19a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:12.160518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.161133 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.163209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1343/2685] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:12 2022] DELETE /identity/v3/projects/a145143c34c54e6ba1d4453c10d19a63 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:12.167235 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677716a4-aa99-48df-ac50-94279efd340e service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:12.176817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677716a4-aa99-48df-ac50-94279efd340e service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:12.231328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371c974-5908-4aab-b5c5-de1398915aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:12.232106 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371c974-5908-4aab-b5c5-de1398915aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:12.232415 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371c974-5908-4aab-b5c5-de1398915aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:12.232691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371c974-5908-4aab-b5c5-de1398915aa8 admin admin] PATH_INFO: `/v3/users/727e81f0d2ed4d44aeb80fa70ec533d0` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:12.233851 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371c974-5908-4aab-b5c5-de1398915aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=727e81f0d2ed4d44aeb80fa70ec533d0)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:12.235760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371c974-5908-4aab-b5c5-de1398915aa8 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:12.279910 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b371c974-5908-4aab-b5c5-de1398915aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727e81f0d2ed4d44aeb80fa70ec533d0'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.286561 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b371c974-5908-4aab-b5c5-de1398915aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727e81f0d2ed4d44aeb80fa70ec533d0'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.293822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b371c974-5908-4aab-b5c5-de1398915aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727e81f0d2ed4d44aeb80fa70ec533d0'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.294431 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b371c974-5908-4aab-b5c5-de1398915aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727e81f0d2ed4d44aeb80fa70ec533d0'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.295126 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b371c974-5908-4aab-b5c5-de1398915aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727e81f0d2ed4d44aeb80fa70ec533d0'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.311814 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1343/2686] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:12 2022] DELETE /identity/v3/users/727e81f0d2ed4d44aeb80fa70ec533d0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:12.594622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:12.596433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:12.612192 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a2c50-cdfa-4f46-a95d-86bcc4a9da08 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:12.666969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:12.667818 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:12.668098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:12.668404 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] PATH_INFO: `/v3/projects/b22d0623051a409f8da0fbed275ffc1f` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:12.669557 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22d0623051a409f8da0fbed275ffc1f)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:12.671443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:12.715464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22d0623051a409f8da0fbed275ffc1f', 'request_id': 'req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.721373 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22d0623051a409f8da0fbed275ffc1f', 'request_id': 'req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.727412 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22d0623051a409f8da0fbed275ffc1f', 'request_id': 'req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.739547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] The token cache is being invalidate because project b22d0623051a409f8da0fbed275ffc1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:12.739850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.740583 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-3b2c0d06-dbde-4d97-9e74-f39fe8e75e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:12.742250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1344/2687] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:12 2022] DELETE /identity/v3/projects/b22d0623051a409f8da0fbed275ffc1f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:12.747565 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8633e6f-6ea9-4f1a-b859-bb12dc043727 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:12.747858 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8633e6f-6ea9-4f1a-b859-bb12dc043727 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:12.748139 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8633e6f-6ea9-4f1a-b859-bb12dc043727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:12.765661 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-d8633e6f-6ea9-4f1a-b859-bb12dc043727 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:12.766837 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d8633e6f-6ea9-4f1a-b859-bb12dc043727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:12.823455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1344/2688] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:12.831301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e0432-bc3a-4125-8aa6-31229d12b85e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:12.831594 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e0432-bc3a-4125-8aa6-31229d12b85e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:12.831874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e0432-bc3a-4125-8aa6-31229d12b85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:12.850699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ce1e0432-bc3a-4125-8aa6-31229d12b85e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:12.851881 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ce1e0432-bc3a-4125-8aa6-31229d12b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:12.859617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1345/2689] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:12.863639 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8633e6f-6ea9-4f1a-b859-bb12dc043727 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:12.873190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8633e6f-6ea9-4f1a-b859-bb12dc043727 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:12.877686 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19662485-09e7-42df-8921-ec01a601b5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:12.878332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19662485-09e7-42df-8921-ec01a601b5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:12.878614 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19662485-09e7-42df-8921-ec01a601b5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:12.878888 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19662485-09e7-42df-8921-ec01a601b5f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:12.879617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19662485-09e7-42df-8921-ec01a601b5f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:18:12.879944 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19662485-09e7-42df-8921-ec01a601b5f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:12.881551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19662485-09e7-42df-8921-ec01a601b5f9 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:12.892788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1345/2690] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:18:12.897435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e0432-bc3a-4125-8aa6-31229d12b85e None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:12.906771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e0432-bc3a-4125-8aa6-31229d12b85e None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:12.911385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47301275-4697-45c5-acea-e46dd69fc24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:12.912738 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47301275-4697-45c5-acea-e46dd69fc24f admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:12.913033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47301275-4697-45c5-acea-e46dd69fc24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:12.913308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47301275-4697-45c5-acea-e46dd69fc24f admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:12.913997 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47301275-4697-45c5-acea-e46dd69fc24f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:12.915864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47301275-4697-45c5-acea-e46dd69fc24f admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:12.941495 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1346/2691] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:12 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:18:12.945639 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19662485-09e7-42df-8921-ec01a601b5f9 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:12.955414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19662485-09e7-42df-8921-ec01a601b5f9 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.009085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f994895-d2f7-4e8c-81ba-7b274a4779fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.009733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f994895-d2f7-4e8c-81ba-7b274a4779fc admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.010014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f994895-d2f7-4e8c-81ba-7b274a4779fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.010286 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f994895-d2f7-4e8c-81ba-7b274a4779fc admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.010968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f994895-d2f7-4e8c-81ba-7b274a4779fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:13.012899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f994895-d2f7-4e8c-81ba-7b274a4779fc admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:13.031571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1346/2692] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:12 2022] POST /identity/v3/users => generated 301 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:13.035515 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47301275-4697-45c5-acea-e46dd69fc24f admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:13.046518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47301275-4697-45c5-acea-e46dd69fc24f admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.051041 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ebbd7-0553-43a8-adc9-6f81802c82fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.051689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebbd7-0553-43a8-adc9-6f81802c82fd admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.051970 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebbd7-0553-43a8-adc9-6f81802c82fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.052273 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebbd7-0553-43a8-adc9-6f81802c82fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.053527 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ebbd7-0553-43a8-adc9-6f81802c82fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:13.055115 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ebbd7-0553-43a8-adc9-6f81802c82fd admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:13.066181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1347/2693] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:18:13.070194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f994895-d2f7-4e8c-81ba-7b274a4779fc admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:13.079950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f994895-d2f7-4e8c-81ba-7b274a4779fc admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.084634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378061c-9b9e-4959-b774-b4df449db7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.085271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378061c-9b9e-4959-b774-b4df449db7ce admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.085551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378061c-9b9e-4959-b774-b4df449db7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.085825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378061c-9b9e-4959-b774-b4df449db7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.086539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378061c-9b9e-4959-b774-b4df449db7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:13.088116 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378061c-9b9e-4959-b774-b4df449db7ce admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:13.097633 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1347/2694] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:18:13.102278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ebbd7-0553-43a8-adc9-6f81802c82fd admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:13.111698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ebbd7-0553-43a8-adc9-6f81802c82fd admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.116718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da6d75-3d89-4512-aa6a-5aa3bea47475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.117570 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da6d75-3d89-4512-aa6a-5aa3bea47475 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.117842 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da6d75-3d89-4512-aa6a-5aa3bea47475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.118108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da6d75-3d89-4512-aa6a-5aa3bea47475 admin admin] PATH_INFO: `/v3/projects/26cce676ded543dd90665a7ce5ae24f0/users/e14d19e4af894344a663d7e9e93a4532/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.132065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da6d75-3d89-4512-aa6a-5aa3bea47475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cce676ded543dd90665a7ce5ae24f0, user_id=e14d19e4af894344a663d7e9e93a4532, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:13.134719 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da6d75-3d89-4512-aa6a-5aa3bea47475 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:13.147637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1348/2695] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:13 2022] PUT /identity/v3/projects/26cce676ded543dd90665a7ce5ae24f0/users/e14d19e4af894344a663d7e9e93a4532/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:13.158823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215769-c675-4a1d-8d5a-a4bc923a9a85 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.159119 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215769-c675-4a1d-8d5a-a4bc923a9a85 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.159397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215769-c675-4a1d-8d5a-a4bc923a9a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.185865 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-98215769-c675-4a1d-8d5a-a4bc923a9a85 None None] MFA Rules not processed for user `e14d19e4af894344a663d7e9e93a4532`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:13.187045 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-98215769-c675-4a1d-8d5a-a4bc923a9a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:13.250102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1348/2696] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:13.254929 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da6d75-3d89-4512-aa6a-5aa3bea47475 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:13.313940 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da6d75-3d89-4512-aa6a-5aa3bea47475 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.318622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784906d-1bbe-46f6-9226-f2ff0636fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.319285 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784906d-1bbe-46f6-9226-f2ff0636fe72 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.319568 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784906d-1bbe-46f6-9226-f2ff0636fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.319844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784906d-1bbe-46f6-9226-f2ff0636fe72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.320561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784906d-1bbe-46f6-9226-f2ff0636fe72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:13.322450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784906d-1bbe-46f6-9226-f2ff0636fe72 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:13.346606 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1349/2697] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:13 2022] POST /identity/v3/projects => generated 401 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:13.351322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98215769-c675-4a1d-8d5a-a4bc923a9a85 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:13.361805 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98215769-c675-4a1d-8d5a-a4bc923a9a85 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.417761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6a33d-2c44-4f94-8ea3-2ba5529f5241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.418457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6a33d-2c44-4f94-8ea3-2ba5529f5241 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.418735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6a33d-2c44-4f94-8ea3-2ba5529f5241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.419008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6a33d-2c44-4f94-8ea3-2ba5529f5241 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.419732 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6a33d-2c44-4f94-8ea3-2ba5529f5241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:13.421657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6a33d-2c44-4f94-8ea3-2ba5529f5241 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:13.441118 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1349/2698] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:13 2022] POST /identity/v3/users => generated 307 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:18:13.445097 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784906d-1bbe-46f6-9226-f2ff0636fe72 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:13.455181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784906d-1bbe-46f6-9226-f2ff0636fe72 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.460300 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6053e-b108-4a81-8b8c-aa7ce0423a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.460953 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6053e-b108-4a81-8b8c-aa7ce0423a13 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.461235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6053e-b108-4a81-8b8c-aa7ce0423a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.461506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6053e-b108-4a81-8b8c-aa7ce0423a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.462220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6053e-b108-4a81-8b8c-aa7ce0423a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:13.463812 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6053e-b108-4a81-8b8c-aa7ce0423a13 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:13.475506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1350/2699] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:18:13.479435 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6a33d-2c44-4f94-8ea3-2ba5529f5241 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:13.489321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6a33d-2c44-4f94-8ea3-2ba5529f5241 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.494628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8efee-0982-4131-8b42-a47630c76c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.495753 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8efee-0982-4131-8b42-a47630c76c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.496039 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8efee-0982-4131-8b42-a47630c76c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.496354 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8efee-0982-4131-8b42-a47630c76c28 admin admin] PATH_INFO: `/v3/projects/9424dd5431ba418db3519ffe648ac3d4/users/6644897522e4450d9d0a771a1e24a761/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.513199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8efee-0982-4131-8b42-a47630c76c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9424dd5431ba418db3519ffe648ac3d4, user_id=6644897522e4450d9d0a771a1e24a761, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:13.515967 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8efee-0982-4131-8b42-a47630c76c28 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:13.531667 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1350/2700] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:13 2022] PUT /identity/v3/projects/9424dd5431ba418db3519ffe648ac3d4/users/6644897522e4450d9d0a771a1e24a761/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:13.535611 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6053e-b108-4a81-8b8c-aa7ce0423a13 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:13.546716 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6053e-b108-4a81-8b8c-aa7ce0423a13 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.602301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d258107-104c-4f5a-839e-a447ef3f4faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.602975 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d258107-104c-4f5a-839e-a447ef3f4faa admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.603272 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d258107-104c-4f5a-839e-a447ef3f4faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.603545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d258107-104c-4f5a-839e-a447ef3f4faa admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.604343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d258107-104c-4f5a-839e-a447ef3f4faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:13.606022 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d258107-104c-4f5a-839e-a447ef3f4faa admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:13.616371 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1351/2701] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:13.620439 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8efee-0982-4131-8b42-a47630c76c28 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:13.630356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8efee-0982-4131-8b42-a47630c76c28 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.635547 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c2059-b840-4acb-b508-614a4ef3bb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.636447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c2059-b840-4acb-b508-614a4ef3bb71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.636729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c2059-b840-4acb-b508-614a4ef3bb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.637002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c2059-b840-4acb-b508-614a4ef3bb71 admin admin] PATH_INFO: `/v3/projects/9424dd5431ba418db3519ffe648ac3d4/users/6644897522e4450d9d0a771a1e24a761/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.638953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c2059-b840-4acb-b508-614a4ef3bb71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9424dd5431ba418db3519ffe648ac3d4, user_id=6644897522e4450d9d0a771a1e24a761, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:13.641600 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c2059-b840-4acb-b508-614a4ef3bb71 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:13.651597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1351/2702] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:13 2022] PUT /identity/v3/projects/9424dd5431ba418db3519ffe648ac3d4/users/6644897522e4450d9d0a771a1e24a761/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:13.661324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb4faa-f1f4-4aac-8f0f-f590debbfbb3 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.661618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb4faa-f1f4-4aac-8f0f-f590debbfbb3 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.661899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb4faa-f1f4-4aac-8f0f-f590debbfbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.688398 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-7acb4faa-f1f4-4aac-8f0f-f590debbfbb3 None None] MFA Rules not processed for user `6644897522e4450d9d0a771a1e24a761`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:13.689593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7acb4faa-f1f4-4aac-8f0f-f590debbfbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:13.756857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1352/2703] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:13.767579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c2059-b840-4acb-b508-614a4ef3bb71 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:13.769665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6f5c2059-b840-4acb-b508-614a4ef3bb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:13.826755 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c2059-b840-4acb-b508-614a4ef3bb71 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.830587 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e7afb-0cce-4e65-b9fe-52747f515120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.831190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e7afb-0cce-4e65-b9fe-52747f515120 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.831472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e7afb-0cce-4e65-b9fe-52747f515120 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.831864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e7afb-0cce-4e65-b9fe-52747f515120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:13.841332 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e7afb-0cce-4e65-b9fe-52747f515120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:13.842877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e7afb-0cce-4e65-b9fe-52747f515120 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:13.852889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1352/2704] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:13.927323 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb4faa-f1f4-4aac-8f0f-f590debbfbb3 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:13.938354 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb4faa-f1f4-4aac-8f0f-f590debbfbb3 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:13.942847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e0782-7e04-401d-89c9-4783c1f96de9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:13.943623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e0782-7e04-401d-89c9-4783c1f96de9 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:13.943914 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e0782-7e04-401d-89c9-4783c1f96de9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:13.944214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e0782-7e04-401d-89c9-4783c1f96de9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:14.011278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e0782-7e04-401d-89c9-4783c1f96de9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:14.012888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e0782-7e04-401d-89c9-4783c1f96de9 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:14.022725 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1353/2705] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:16.935183 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e7afb-0cce-4e65-b9fe-52747f515120 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:16.936585 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-543e7afb-0cce-4e65-b9fe-52747f515120 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:17.000247 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e7afb-0cce-4e65-b9fe-52747f515120 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:17.004758 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:17.006105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:17.006396 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:17.006670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] PATH_INFO: `/v3/users/c7eaa7b682c6421886a3db442224bd33` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:17.007855 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7eaa7b682c6421886a3db442224bd33)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:17.009814 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:17.054296 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7eaa7b682c6421886a3db442224bd33'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.060961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7eaa7b682c6421886a3db442224bd33'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.068012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7eaa7b682c6421886a3db442224bd33'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.069148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7eaa7b682c6421886a3db442224bd33'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.069735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7eaa7b682c6421886a3db442224bd33'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.087086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1353/2706] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:16 2022] DELETE /identity/v3/users/c7eaa7b682c6421886a3db442224bd33 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:17.091585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef273522-a2c5-4276-8737-ea7d480bc3da None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:17.092059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef273522-a2c5-4276-8737-ea7d480bc3da None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:17.092203 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef273522-a2c5-4276-8737-ea7d480bc3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:17.108808 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ef273522-a2c5-4276-8737-ea7d480bc3da None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:17.109971 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ef273522-a2c5-4276-8737-ea7d480bc3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:17.165791 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1354/2707] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:17.175429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:17.176847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:17.232276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e70726-5802-422e-8428-3a4b13db2a85 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:17.235879 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf109ac8-289e-469f-bf19-ea997b3f650e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:17.236542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ac8-289e-469f-bf19-ea997b3f650e service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:17.236827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ac8-289e-469f-bf19-ea997b3f650e service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:17.237107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ac8-289e-469f-bf19-ea997b3f650e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:17.246679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf109ac8-289e-469f-bf19-ea997b3f650e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:17.248108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf109ac8-289e-469f-bf19-ea997b3f650e service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:17.258030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1354/2708] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:17.510994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef273522-a2c5-4276-8737-ea7d480bc3da None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:17.512618 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ef273522-a2c5-4276-8737-ea7d480bc3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:17.525331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef273522-a2c5-4276-8737-ea7d480bc3da None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:17.531199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:17.532078 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:17.532389 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:17.532780 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] PATH_INFO: `/v3/projects/e1796d32e63748e997e2332f39779b5a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:17.533852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1796d32e63748e997e2332f39779b5a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:17.536541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:17.587165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1796d32e63748e997e2332f39779b5a', 'request_id': 'req-9dfba817-9a99-4064-93ef-8d67f652bc49'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.593316 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1796d32e63748e997e2332f39779b5a', 'request_id': 'req-9dfba817-9a99-4064-93ef-8d67f652bc49'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.599175 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1796d32e63748e997e2332f39779b5a', 'request_id': 'req-9dfba817-9a99-4064-93ef-8d67f652bc49'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.611476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] The token cache is being invalidate because project e1796d32e63748e997e2332f39779b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:17.611757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.612391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.613916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1355/2709] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:17 2022] DELETE /identity/v3/projects/e1796d32e63748e997e2332f39779b5a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:17.618611 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf109ac8-289e-469f-bf19-ea997b3f650e service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:17.628086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf109ac8-289e-469f-bf19-ea997b3f650e service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:17.682156 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e901c8-265a-4e2b-b690-bfee75115375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:17.683010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e901c8-265a-4e2b-b690-bfee75115375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:17.683316 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e901c8-265a-4e2b-b690-bfee75115375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:17.683594 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e901c8-265a-4e2b-b690-bfee75115375 admin admin] PATH_INFO: `/v3/users/873fe81e92754d379dafffe3e0c13c30` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:17.684918 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e901c8-265a-4e2b-b690-bfee75115375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=873fe81e92754d379dafffe3e0c13c30)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:17.687054 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e901c8-265a-4e2b-b690-bfee75115375 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:17.730938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-98e901c8-265a-4e2b-b690-bfee75115375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873fe81e92754d379dafffe3e0c13c30'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.737472 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-98e901c8-265a-4e2b-b690-bfee75115375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873fe81e92754d379dafffe3e0c13c30'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.744869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-98e901c8-265a-4e2b-b690-bfee75115375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873fe81e92754d379dafffe3e0c13c30'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.745495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-98e901c8-265a-4e2b-b690-bfee75115375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873fe81e92754d379dafffe3e0c13c30'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.746110 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-98e901c8-265a-4e2b-b690-bfee75115375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873fe81e92754d379dafffe3e0c13c30'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:17.763371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1355/2710] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:17 2022] DELETE /identity/v3/users/873fe81e92754d379dafffe3e0c13c30 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:18.267857 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:18.269694 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:18.286087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfba817-9a99-4064-93ef-8d67f652bc49 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:18.341850 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:18.342706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:18.342994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:18.343269 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] PATH_INFO: `/v3/projects/a663f7ad35ba4397aaac6ce4afb84006` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:18.344461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a663f7ad35ba4397aaac6ce4afb84006)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:18.346352 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:18.390050 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a663f7ad35ba4397aaac6ce4afb84006', 'request_id': 'req-28c01e3e-08d2-4837-a5be-5773280073f0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:18.395772 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a663f7ad35ba4397aaac6ce4afb84006', 'request_id': 'req-28c01e3e-08d2-4837-a5be-5773280073f0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:18.401184 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a663f7ad35ba4397aaac6ce4afb84006', 'request_id': 'req-28c01e3e-08d2-4837-a5be-5773280073f0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:18.413607 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] The token cache is being invalidate because project a663f7ad35ba4397aaac6ce4afb84006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:18.413889 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:18.414528 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-28c01e3e-08d2-4837-a5be-5773280073f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:18.416058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1356/2711] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:18 2022] DELETE /identity/v3/projects/a663f7ad35ba4397aaac6ce4afb84006 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:18.421034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08de89-09f9-4747-be11-95b1c50363c7 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:18.421513 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08de89-09f9-4747-be11-95b1c50363c7 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:18.421619 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08de89-09f9-4747-be11-95b1c50363c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:18.439374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-2a08de89-09f9-4747-be11-95b1c50363c7 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:18.440634 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2a08de89-09f9-4747-be11-95b1c50363c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:18.505298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1356/2712] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:18.508833 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09496-a5e5-4f5c-b05c-394a93c1adfb None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:18.509125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09496-a5e5-4f5c-b05c-394a93c1adfb None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:18.509403 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab09496-a5e5-4f5c-b05c-394a93c1adfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:18.528907 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1ab09496-a5e5-4f5c-b05c-394a93c1adfb None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:18.530170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1ab09496-a5e5-4f5c-b05c-394a93c1adfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:18.538821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1357/2713] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:18.543177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08de89-09f9-4747-be11-95b1c50363c7 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:18.553535 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08de89-09f9-4747-be11-95b1c50363c7 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:18.558080 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dd7e9-ca05-4cd5-adaa-ae820e687b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:18.558727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd7e9-ca05-4cd5-adaa-ae820e687b85 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:18.559008 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd7e9-ca05-4cd5-adaa-ae820e687b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:18.559286 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd7e9-ca05-4cd5-adaa-ae820e687b85 admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:18.560012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dd7e9-ca05-4cd5-adaa-ae820e687b85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:18:18.560360 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dd7e9-ca05-4cd5-adaa-ae820e687b85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:18.561950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dd7e9-ca05-4cd5-adaa-ae820e687b85 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:18.573957 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1357/2714] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:18:18.578378 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09496-a5e5-4f5c-b05c-394a93c1adfb None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:18.587317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab09496-a5e5-4f5c-b05c-394a93c1adfb None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:18.591929 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1afb0e-5635-44f2-a77d-3b3a2d4349a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:18.592613 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1afb0e-5635-44f2-a77d-3b3a2d4349a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:18.592894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1afb0e-5635-44f2-a77d-3b3a2d4349a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:18.593204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1afb0e-5635-44f2-a77d-3b3a2d4349a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:18.593947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1afb0e-5635-44f2-a77d-3b3a2d4349a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:18.596074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1afb0e-5635-44f2-a77d-3b3a2d4349a5 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:18.621691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1358/2715] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:18 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:18:18.625890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dd7e9-ca05-4cd5-adaa-ae820e687b85 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:18.635733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dd7e9-ca05-4cd5-adaa-ae820e687b85 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:18.689618 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974466c-9e9c-4c76-b38e-dd89918838af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:18.690274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974466c-9e9c-4c76-b38e-dd89918838af admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:18.690556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974466c-9e9c-4c76-b38e-dd89918838af admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:18.690848 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974466c-9e9c-4c76-b38e-dd89918838af admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:18.691526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974466c-9e9c-4c76-b38e-dd89918838af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:18.693447 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974466c-9e9c-4c76-b38e-dd89918838af admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:18.712977 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1358/2716] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:18 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:18.717058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1afb0e-5635-44f2-a77d-3b3a2d4349a5 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:18.727836 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1afb0e-5635-44f2-a77d-3b3a2d4349a5 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:18.732453 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba85ba-925c-447b-86de-9c5de3c913b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:18.733120 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba85ba-925c-447b-86de-9c5de3c913b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:18.733387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba85ba-925c-447b-86de-9c5de3c913b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:18.733662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba85ba-925c-447b-86de-9c5de3c913b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:18.734384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba85ba-925c-447b-86de-9c5de3c913b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:18.735976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba85ba-925c-447b-86de-9c5de3c913b7 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:18.746301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1359/2717] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:18.750272 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974466c-9e9c-4c76-b38e-dd89918838af admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:18.760679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974466c-9e9c-4c76-b38e-dd89918838af admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:18.765309 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67204c68-c218-4d9c-82ea-10d84560fa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:18.765961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204c68-c218-4d9c-82ea-10d84560fa05 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:18.766250 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204c68-c218-4d9c-82ea-10d84560fa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:18.766532 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67204c68-c218-4d9c-82ea-10d84560fa05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:18.767259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67204c68-c218-4d9c-82ea-10d84560fa05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:18.768891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67204c68-c218-4d9c-82ea-10d84560fa05 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:18.779129 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1359/2718] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:18.783083 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba85ba-925c-447b-86de-9c5de3c913b7 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:18.793239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba85ba-925c-447b-86de-9c5de3c913b7 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:18.797792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08b4a7-4756-468e-8a5c-6c4795b04a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:18.798662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08b4a7-4756-468e-8a5c-6c4795b04a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:18.798942 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08b4a7-4756-468e-8a5c-6c4795b04a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:18.799219 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08b4a7-4756-468e-8a5c-6c4795b04a33 admin admin] PATH_INFO: `/v3/projects/d8d22c9e083c43aa8a8ca226cfba1504/users/e16a7bc2056b4789a68c4ddb8a3890a7/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:18.813479 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08b4a7-4756-468e-8a5c-6c4795b04a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d22c9e083c43aa8a8ca226cfba1504, user_id=e16a7bc2056b4789a68c4ddb8a3890a7, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:18.816126 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08b4a7-4756-468e-8a5c-6c4795b04a33 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:18.829212 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1360/2719] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:18 2022] PUT /identity/v3/projects/d8d22c9e083c43aa8a8ca226cfba1504/users/e16a7bc2056b4789a68c4ddb8a3890a7/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:18.839586 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ee245-85f8-4a2f-9932-842b6f9cddef None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:18.839881 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ee245-85f8-4a2f-9932-842b6f9cddef None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:18.840390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ee245-85f8-4a2f-9932-842b6f9cddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:18.868598 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-d45ee245-85f8-4a2f-9932-842b6f9cddef None None] MFA Rules not processed for user `e16a7bc2056b4789a68c4ddb8a3890a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:18.869794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d45ee245-85f8-4a2f-9932-842b6f9cddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:18.932343 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1360/2720] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:18.936794 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08b4a7-4756-468e-8a5c-6c4795b04a33 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:18.997199 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08b4a7-4756-468e-8a5c-6c4795b04a33 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:19.001902 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25733f-3a1d-4d1f-9241-e2bf484d12df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:19.002551 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25733f-3a1d-4d1f-9241-e2bf484d12df admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:19.002834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25733f-3a1d-4d1f-9241-e2bf484d12df admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:19.003109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25733f-3a1d-4d1f-9241-e2bf484d12df admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:19.003782 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25733f-3a1d-4d1f-9241-e2bf484d12df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:19.006506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25733f-3a1d-4d1f-9241-e2bf484d12df admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:19.040949 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1361/2721] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:18 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:19.044866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ee245-85f8-4a2f-9932-842b6f9cddef None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:19.055662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ee245-85f8-4a2f-9932-842b6f9cddef None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:19.110017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7edf9-b698-4bc2-9fa1-f0a5f1b8d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:19.110678 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7edf9-b698-4bc2-9fa1-f0a5f1b8d127 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:19.110964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7edf9-b698-4bc2-9fa1-f0a5f1b8d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:19.111243 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7edf9-b698-4bc2-9fa1-f0a5f1b8d127 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:19.111926 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7edf9-b698-4bc2-9fa1-f0a5f1b8d127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:19.113859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7edf9-b698-4bc2-9fa1-f0a5f1b8d127 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:19.133697 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1361/2722] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:19 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:19.137625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25733f-3a1d-4d1f-9241-e2bf484d12df admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:19.148595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25733f-3a1d-4d1f-9241-e2bf484d12df admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:19.153591 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899eb19-7be1-4b92-a885-c2d9a5593834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:19.154253 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899eb19-7be1-4b92-a885-c2d9a5593834 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:19.154536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899eb19-7be1-4b92-a885-c2d9a5593834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:19.154811 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899eb19-7be1-4b92-a885-c2d9a5593834 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:19.155564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899eb19-7be1-4b92-a885-c2d9a5593834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:19.157211 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899eb19-7be1-4b92-a885-c2d9a5593834 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:19.167844 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1362/2723] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:19.171869 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7edf9-b698-4bc2-9fa1-f0a5f1b8d127 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:19.183744 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7edf9-b698-4bc2-9fa1-f0a5f1b8d127 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:19.188409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c6103-028d-47da-80dd-17a6a29951dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:19.189313 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c6103-028d-47da-80dd-17a6a29951dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:19.189595 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c6103-028d-47da-80dd-17a6a29951dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:19.189872 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c6103-028d-47da-80dd-17a6a29951dc admin admin] PATH_INFO: `/v3/projects/0e04653af7ae41af8187e9de57738561/users/cfcb0d9c5c904d6684cd72e78cca4a60/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:19.205434 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c6103-028d-47da-80dd-17a6a29951dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e04653af7ae41af8187e9de57738561, user_id=cfcb0d9c5c904d6684cd72e78cca4a60, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:19.208117 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c6103-028d-47da-80dd-17a6a29951dc admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:19.221841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1362/2724] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:19 2022] PUT /identity/v3/projects/0e04653af7ae41af8187e9de57738561/users/cfcb0d9c5c904d6684cd72e78cca4a60/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:19.226478 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899eb19-7be1-4b92-a885-c2d9a5593834 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:19.236151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899eb19-7be1-4b92-a885-c2d9a5593834 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:19.295784 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd512cb1-9f09-4e0b-85c4-89ab9c279b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:19.296457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512cb1-9f09-4e0b-85c4-89ab9c279b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:19.296693 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512cb1-9f09-4e0b-85c4-89ab9c279b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:19.296974 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512cb1-9f09-4e0b-85c4-89ab9c279b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:19.297701 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd512cb1-9f09-4e0b-85c4-89ab9c279b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:19.299301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd512cb1-9f09-4e0b-85c4-89ab9c279b13 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:19.309144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1363/2725] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:19.313409 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c6103-028d-47da-80dd-17a6a29951dc admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:19.324134 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c6103-028d-47da-80dd-17a6a29951dc admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:19.329018 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352f52a-b9ea-46ee-88c2-c5383c1e574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:19.329891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352f52a-b9ea-46ee-88c2-c5383c1e574b admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:19.330370 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352f52a-b9ea-46ee-88c2-c5383c1e574b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:19.330654 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352f52a-b9ea-46ee-88c2-c5383c1e574b admin admin] PATH_INFO: `/v3/projects/0e04653af7ae41af8187e9de57738561/users/cfcb0d9c5c904d6684cd72e78cca4a60/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:19.332659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352f52a-b9ea-46ee-88c2-c5383c1e574b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e04653af7ae41af8187e9de57738561, user_id=cfcb0d9c5c904d6684cd72e78cca4a60, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:19.335891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352f52a-b9ea-46ee-88c2-c5383c1e574b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:19.345878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1363/2726] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:19 2022] PUT /identity/v3/projects/0e04653af7ae41af8187e9de57738561/users/cfcb0d9c5c904d6684cd72e78cca4a60/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:19.356101 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20829-266d-4632-b409-b6f990e94793 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:19.356415 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20829-266d-4632-b409-b6f990e94793 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:19.356696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20829-266d-4632-b409-b6f990e94793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:19.383444 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1fa20829-266d-4632-b409-b6f990e94793 None None] MFA Rules not processed for user `cfcb0d9c5c904d6684cd72e78cca4a60`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:19.384657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1fa20829-266d-4632-b409-b6f990e94793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:19.448924 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1364/2727] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:19.460167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352f52a-b9ea-46ee-88c2-c5383c1e574b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:19.462042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-3352f52a-b9ea-46ee-88c2-c5383c1e574b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:19.518227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352f52a-b9ea-46ee-88c2-c5383c1e574b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:19.522056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320c70-c934-448e-ac5c-1b8730ef4dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:19.522720 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320c70-c934-448e-ac5c-1b8730ef4dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:19.523000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320c70-c934-448e-ac5c-1b8730ef4dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:19.523276 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320c70-c934-448e-ac5c-1b8730ef4dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:19.533087 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84320c70-c934-448e-ac5c-1b8730ef4dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:19.534524 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84320c70-c934-448e-ac5c-1b8730ef4dd5 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:19.544392 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1364/2728] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:19.904121 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20829-266d-4632-b409-b6f990e94793 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:19.964331 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20829-266d-4632-b409-b6f990e94793 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:19.968767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:19.969619 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:19.969926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:19.970202 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] PATH_INFO: `/v3/users/e16a7bc2056b4789a68c4ddb8a3890a7` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:19.971418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16a7bc2056b4789a68c4ddb8a3890a7)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:19.973365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:20.015416 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16a7bc2056b4789a68c4ddb8a3890a7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.016055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16a7bc2056b4789a68c4ddb8a3890a7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.023062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16a7bc2056b4789a68c4ddb8a3890a7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.029776 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16a7bc2056b4789a68c4ddb8a3890a7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.030386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16a7bc2056b4789a68c4ddb8a3890a7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.047281 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1365/2729] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:19 2022] DELETE /identity/v3/users/e16a7bc2056b4789a68c4ddb8a3890a7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:20.052064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681db48-1cca-4318-b80c-a6389c4a08a3 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:20.052436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681db48-1cca-4318-b80c-a6389c4a08a3 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:20.052656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681db48-1cca-4318-b80c-a6389c4a08a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:20.071131 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-4681db48-1cca-4318-b80c-a6389c4a08a3 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:20.072338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4681db48-1cca-4318-b80c-a6389c4a08a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:20.130366 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1365/2730] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:20.140564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:20.141995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:20.196775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188074b3-96d7-4ee8-bc7c-e245fc4b6377 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:20.200760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060a45-9ace-4542-9e04-aa02213c0b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:20.201394 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060a45-9ace-4542-9e04-aa02213c0b05 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:20.201680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060a45-9ace-4542-9e04-aa02213c0b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:20.201959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060a45-9ace-4542-9e04-aa02213c0b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:20.210807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49060a45-9ace-4542-9e04-aa02213c0b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:20.212257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49060a45-9ace-4542-9e04-aa02213c0b05 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:20.221381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1366/2731] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:20.477591 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681db48-1cca-4318-b80c-a6389c4a08a3 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:20.479077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-4681db48-1cca-4318-b80c-a6389c4a08a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:20.497589 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681db48-1cca-4318-b80c-a6389c4a08a3 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:20.502404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:20.503240 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:20.503534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:20.503797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] PATH_INFO: `/v3/projects/d8d22c9e083c43aa8a8ca226cfba1504` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:20.505058 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8d22c9e083c43aa8a8ca226cfba1504)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:20.507005 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:20.557452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8d22c9e083c43aa8a8ca226cfba1504', 'request_id': 'req-1b357fd2-19ed-4003-9d9c-d664448eb7ed'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.564751 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8d22c9e083c43aa8a8ca226cfba1504', 'request_id': 'req-1b357fd2-19ed-4003-9d9c-d664448eb7ed'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.570986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8d22c9e083c43aa8a8ca226cfba1504', 'request_id': 'req-1b357fd2-19ed-4003-9d9c-d664448eb7ed'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.581061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] The token cache is being invalidate because project d8d22c9e083c43aa8a8ca226cfba1504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:20.581344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.581958 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.583486 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1366/2732] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:20 2022] DELETE /identity/v3/projects/d8d22c9e083c43aa8a8ca226cfba1504 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:20.588197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060a45-9ace-4542-9e04-aa02213c0b05 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:20.597569 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060a45-9ace-4542-9e04-aa02213c0b05 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:20.650757 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970836b0-9514-4253-a226-a6643cfcc46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:20.651623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970836b0-9514-4253-a226-a6643cfcc46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:20.651894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970836b0-9514-4253-a226-a6643cfcc46e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:20.652166 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970836b0-9514-4253-a226-a6643cfcc46e admin admin] PATH_INFO: `/v3/users/cfcb0d9c5c904d6684cd72e78cca4a60` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:20.653368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970836b0-9514-4253-a226-a6643cfcc46e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfcb0d9c5c904d6684cd72e78cca4a60)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:20.655259 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970836b0-9514-4253-a226-a6643cfcc46e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:20.699485 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-970836b0-9514-4253-a226-a6643cfcc46e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfcb0d9c5c904d6684cd72e78cca4a60'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.700409 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-970836b0-9514-4253-a226-a6643cfcc46e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfcb0d9c5c904d6684cd72e78cca4a60'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.706804 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-970836b0-9514-4253-a226-a6643cfcc46e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfcb0d9c5c904d6684cd72e78cca4a60'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.714694 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-970836b0-9514-4253-a226-a6643cfcc46e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfcb0d9c5c904d6684cd72e78cca4a60'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.715977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-970836b0-9514-4253-a226-a6643cfcc46e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfcb0d9c5c904d6684cd72e78cca4a60'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:20.733593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1367/2733] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:20 2022] DELETE /identity/v3/users/cfcb0d9c5c904d6684cd72e78cca4a60 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:20.999340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.000824 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:21.014041 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b357fd2-19ed-4003-9d9c-d664448eb7ed admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.071429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:21.072584 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.072866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.073140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] PATH_INFO: `/v3/projects/0e04653af7ae41af8187e9de57738561` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.074324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e04653af7ae41af8187e9de57738561)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:21.076503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:21.121972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e04653af7ae41af8187e9de57738561', 'request_id': 'req-5428cd1a-14fa-4623-8b5c-16b26328e68f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:21.131324 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e04653af7ae41af8187e9de57738561', 'request_id': 'req-5428cd1a-14fa-4623-8b5c-16b26328e68f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:21.138172 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e04653af7ae41af8187e9de57738561', 'request_id': 'req-5428cd1a-14fa-4623-8b5c-16b26328e68f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:21.148805 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] The token cache is being invalidate because project 0e04653af7ae41af8187e9de57738561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:21.149093 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:21.149742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5428cd1a-14fa-4623-8b5c-16b26328e68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:21.151313 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1367/2734] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:20 2022] DELETE /identity/v3/projects/0e04653af7ae41af8187e9de57738561 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:21.156863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a00fb-2671-4d22-a95a-178e55040311 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.157158 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a00fb-2671-4d22-a95a-178e55040311 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.157436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a00fb-2671-4d22-a95a-178e55040311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.175391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-469a00fb-2671-4d22-a95a-178e55040311 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:21.176687 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-469a00fb-2671-4d22-a95a-178e55040311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:21.234405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1368/2735] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:21.242797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7049-2065-485b-9f2e-b6f7ec81acb5 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.243108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7049-2065-485b-9f2e-b6f7ec81acb5 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.243383 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7049-2065-485b-9f2e-b6f7ec81acb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.261717 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-e69c7049-2065-485b-9f2e-b6f7ec81acb5 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:21.262890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e69c7049-2065-485b-9f2e-b6f7ec81acb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:21.270602 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1368/2736] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:21.274980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a00fb-2671-4d22-a95a-178e55040311 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.284697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a00fb-2671-4d22-a95a-178e55040311 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.289617 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46615bd6-5721-47c4-97e1-54191d5f874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:21.290345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615bd6-5721-47c4-97e1-54191d5f874a admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.290679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615bd6-5721-47c4-97e1-54191d5f874a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.291059 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615bd6-5721-47c4-97e1-54191d5f874a admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.291972 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46615bd6-5721-47c4-97e1-54191d5f874a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:18:21.292399 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46615bd6-5721-47c4-97e1-54191d5f874a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:21.294344 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46615bd6-5721-47c4-97e1-54191d5f874a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:21.306347 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1369/2737] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:18:21.310632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c7049-2065-485b-9f2e-b6f7ec81acb5 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.320624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c7049-2065-485b-9f2e-b6f7ec81acb5 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.325558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1363-1598-4093-8017-b314e7dc05a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:21.326204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1363-1598-4093-8017-b314e7dc05a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.326519 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1363-1598-4093-8017-b314e7dc05a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.326796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1363-1598-4093-8017-b314e7dc05a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.327479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1363-1598-4093-8017-b314e7dc05a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:21.329489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1363-1598-4093-8017-b314e7dc05a8 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:21.356167 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1369/2738] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:21 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:21.360600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46615bd6-5721-47c4-97e1-54191d5f874a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.371843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46615bd6-5721-47c4-97e1-54191d5f874a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.427770 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bed0a-65b5-45c3-9c02-009383fbddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:21.428468 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bed0a-65b5-45c3-9c02-009383fbddfe admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.429298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bed0a-65b5-45c3-9c02-009383fbddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.429710 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bed0a-65b5-45c3-9c02-009383fbddfe admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.430406 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bed0a-65b5-45c3-9c02-009383fbddfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:21.432454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bed0a-65b5-45c3-9c02-009383fbddfe admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:21.451917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1370/2739] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:21 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:18:21.456323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1363-1598-4093-8017-b314e7dc05a8 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.466268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1363-1598-4093-8017-b314e7dc05a8 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.470853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b28847-4dcc-4691-addb-0305affdc3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:21.471493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b28847-4dcc-4691-addb-0305affdc3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.471773 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b28847-4dcc-4691-addb-0305affdc3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.472046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b28847-4dcc-4691-addb-0305affdc3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.472801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b28847-4dcc-4691-addb-0305affdc3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:21.474370 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b28847-4dcc-4691-addb-0305affdc3e4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:21.484805 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1370/2740] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:21.488697 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bed0a-65b5-45c3-9c02-009383fbddfe admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.499346 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bed0a-65b5-45c3-9c02-009383fbddfe admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.503922 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ea3e4-c503-4acb-9873-c0b936da8f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:21.504622 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ea3e4-c503-4acb-9873-c0b936da8f74 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.504913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ea3e4-c503-4acb-9873-c0b936da8f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.505197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ea3e4-c503-4acb-9873-c0b936da8f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.505923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ea3e4-c503-4acb-9873-c0b936da8f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:21.508173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ea3e4-c503-4acb-9873-c0b936da8f74 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:21.517869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1371/2741] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:21.521904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b28847-4dcc-4691-addb-0305affdc3e4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.531756 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b28847-4dcc-4691-addb-0305affdc3e4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.536390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7107ed5-575e-47a8-8921-7decea2584ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:21.537266 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7107ed5-575e-47a8-8921-7decea2584ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.537545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7107ed5-575e-47a8-8921-7decea2584ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.537819 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7107ed5-575e-47a8-8921-7decea2584ef admin admin] PATH_INFO: `/v3/projects/0f1cdfcf96d04805bc9af76348b3ff08/users/e48c4023554a4883a2a1a5f43e4deb45/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.551984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7107ed5-575e-47a8-8921-7decea2584ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1cdfcf96d04805bc9af76348b3ff08, user_id=e48c4023554a4883a2a1a5f43e4deb45, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:21.555768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7107ed5-575e-47a8-8921-7decea2584ef admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:21.570083 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1371/2742] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:21 2022] PUT /identity/v3/projects/0f1cdfcf96d04805bc9af76348b3ff08/users/e48c4023554a4883a2a1a5f43e4deb45/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:21.580795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e50990-a1ac-488f-860c-b462df3b2290 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.581086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e50990-a1ac-488f-860c-b462df3b2290 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.581362 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e50990-a1ac-488f-860c-b462df3b2290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.607250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c8e50990-a1ac-488f-860c-b462df3b2290 None None] MFA Rules not processed for user `e48c4023554a4883a2a1a5f43e4deb45`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:21.608410 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c8e50990-a1ac-488f-860c-b462df3b2290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:21.670151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1372/2743] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:21.674719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7107ed5-575e-47a8-8921-7decea2584ef admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.736630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7107ed5-575e-47a8-8921-7decea2584ef admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.741777 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be1a99-b54d-4606-833c-a0ae7ebf8c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:21.742436 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be1a99-b54d-4606-833c-a0ae7ebf8c10 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.742714 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be1a99-b54d-4606-833c-a0ae7ebf8c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.742985 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be1a99-b54d-4606-833c-a0ae7ebf8c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.743668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be1a99-b54d-4606-833c-a0ae7ebf8c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:21.745588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be1a99-b54d-4606-833c-a0ae7ebf8c10 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:21.769281 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1372/2744] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:21 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:21.773516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e50990-a1ac-488f-860c-b462df3b2290 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.784105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e50990-a1ac-488f-860c-b462df3b2290 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.844173 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ada080-d06c-4ce8-a6d7-81e15d116dd4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.844556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ada080-d06c-4ce8-a6d7-81e15d116dd4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.844904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ada080-d06c-4ce8-a6d7-81e15d116dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.846105 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d9a68-4da1-4fb8-bd8a-60ebe3420316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:21.846777 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d9a68-4da1-4fb8-bd8a-60ebe3420316 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.847061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d9a68-4da1-4fb8-bd8a-60ebe3420316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.847338 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d9a68-4da1-4fb8-bd8a-60ebe3420316 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.848030 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d9a68-4da1-4fb8-bd8a-60ebe3420316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:21.849979 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d9a68-4da1-4fb8-bd8a-60ebe3420316 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:21.866001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-40ada080-d06c-4ce8-a6d7-81e15d116dd4 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:21.867724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-40ada080-d06c-4ce8-a6d7-81e15d116dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:21.871257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1373/2745] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:21 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:21.875316 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d9a68-4da1-4fb8-bd8a-60ebe3420316 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.884584 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d9a68-4da1-4fb8-bd8a-60ebe3420316 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.889554 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5e06e-d31a-4f99-8e94-a7f8bfbc4099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:21.890214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5e06e-d31a-4f99-8e94-a7f8bfbc4099 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.890501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5e06e-d31a-4f99-8e94-a7f8bfbc4099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.890833 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5e06e-d31a-4f99-8e94-a7f8bfbc4099 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.891571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5e06e-d31a-4f99-8e94-a7f8bfbc4099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:21.893220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5e06e-d31a-4f99-8e94-a7f8bfbc4099 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:21.904064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1374/2746] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:18:21.908122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5e06e-d31a-4f99-8e94-a7f8bfbc4099 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.919073 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5e06e-d31a-4f99-8e94-a7f8bfbc4099 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.923928 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240499d-b113-4e84-8e68-29bd68bff479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:21.924866 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240499d-b113-4e84-8e68-29bd68bff479 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:21.925263 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240499d-b113-4e84-8e68-29bd68bff479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:21.925544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240499d-b113-4e84-8e68-29bd68bff479 admin admin] PATH_INFO: `/v3/projects/22ba3fa224554849b10e99a5bb3421fa/users/72aa05a333cc43299a8865ab95761620/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:21.927783 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1373/2747] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:18:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:21.943798 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240499d-b113-4e84-8e68-29bd68bff479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ba3fa224554849b10e99a5bb3421fa, user_id=72aa05a333cc43299a8865ab95761620, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:21.947359 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240499d-b113-4e84-8e68-29bd68bff479 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:21.961233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1375/2748] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:21 2022] PUT /identity/v3/projects/22ba3fa224554849b10e99a5bb3421fa/users/72aa05a333cc43299a8865ab95761620/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:18:21.965443 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ada080-d06c-4ce8-a6d7-81e15d116dd4 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.978216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240499d-b113-4e84-8e68-29bd68bff479 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:21.978496 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ada080-d06c-4ce8-a6d7-81e15d116dd4 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:21.980109 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b240499d-b113-4e84-8e68-29bd68bff479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:22.034850 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c4ae6-25a0-416d-8d7b-c03c342ead7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:22.035549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c4ae6-25a0-416d-8d7b-c03c342ead7b admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:22.035832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c4ae6-25a0-416d-8d7b-c03c342ead7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:22.036108 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c4ae6-25a0-416d-8d7b-c03c342ead7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:22.036871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c4ae6-25a0-416d-8d7b-c03c342ead7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:22.039073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c4ae6-25a0-416d-8d7b-c03c342ead7b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:22.052034 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1374/2749] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:22.052298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240499d-b113-4e84-8e68-29bd68bff479 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:22.053050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c4ae6-25a0-416d-8d7b-c03c342ead7b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:22.055395 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a973daf-e025-4836-82c2-eddf63125b8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:22.056048 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a973daf-e025-4836-82c2-eddf63125b8d service swift] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:22.056370 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a973daf-e025-4836-82c2-eddf63125b8d service swift] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:22.056649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a973daf-e025-4836-82c2-eddf63125b8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:22.062843 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c4ae6-25a0-416d-8d7b-c03c342ead7b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:22.067489 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8f2b-ac7e-4b53-a55c-356b45dbeb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:22.068377 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8f2b-ac7e-4b53-a55c-356b45dbeb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:22.068662 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8f2b-ac7e-4b53-a55c-356b45dbeb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:22.068939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8f2b-ac7e-4b53-a55c-356b45dbeb7a admin admin] PATH_INFO: `/v3/projects/22ba3fa224554849b10e99a5bb3421fa/users/72aa05a333cc43299a8865ab95761620/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:22.070954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d8f2b-ac7e-4b53-a55c-356b45dbeb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ba3fa224554849b10e99a5bb3421fa, user_id=72aa05a333cc43299a8865ab95761620, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:22.073620 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d8f2b-ac7e-4b53-a55c-356b45dbeb7a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:22.084107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1375/2750] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:22 2022] PUT /identity/v3/projects/22ba3fa224554849b10e99a5bb3421fa/users/72aa05a333cc43299a8865ab95761620/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:22.095372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc577c-492d-419f-abdc-512af58b51e9 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:22.095659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc577c-492d-419f-abdc-512af58b51e9 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:22.095938 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc577c-492d-419f-abdc-512af58b51e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:22.112214 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a973daf-e025-4836-82c2-eddf63125b8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:22.113820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a973daf-e025-4836-82c2-eddf63125b8d service swift] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:22.122205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1376/2751] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:18:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 12:18:22.122794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-50fc577c-492d-419f-abdc-512af58b51e9 None None] MFA Rules not processed for user `72aa05a333cc43299a8865ab95761620`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:22.124056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-50fc577c-492d-419f-abdc-512af58b51e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:22.216082 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1376/2752] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:22.232518 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a973daf-e025-4836-82c2-eddf63125b8d service swift] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:22.234118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-4a973daf-e025-4836-82c2-eddf63125b8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:22.309795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a973daf-e025-4836-82c2-eddf63125b8d service swift] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:22.344371 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc577c-492d-419f-abdc-512af58b51e9 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:22.346255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-50fc577c-492d-419f-abdc-512af58b51e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:22.370530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e2542-3f0a-4d5a-9e57-59aefd91cea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:22.371324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e2542-3f0a-4d5a-9e57-59aefd91cea8 service cinder] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:22.372113 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e2542-3f0a-4d5a-9e57-59aefd91cea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:22.372560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e2542-3f0a-4d5a-9e57-59aefd91cea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:22.384674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e2542-3f0a-4d5a-9e57-59aefd91cea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:22.384849 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e2542-3f0a-4d5a-9e57-59aefd91cea8 service cinder] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:22.395476 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1377/2753] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:18:22.452897 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc577c-492d-419f-abdc-512af58b51e9 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:22.463555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:22.464950 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:22.465270 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:22.465644 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] PATH_INFO: `/v3/users/e14d19e4af894344a663d7e9e93a4532` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:22.466885 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14d19e4af894344a663d7e9e93a4532)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:22.468836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:22.542832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14d19e4af894344a663d7e9e93a4532'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:22.553470 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14d19e4af894344a663d7e9e93a4532'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:22.563280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14d19e4af894344a663d7e9e93a4532'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:22.563964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14d19e4af894344a663d7e9e93a4532'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:22.564605 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14d19e4af894344a663d7e9e93a4532'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:22.588850 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1377/2754] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:22 2022] DELETE /identity/v3/users/e14d19e4af894344a663d7e9e93a4532 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:22.592152 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:22.592807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c2765-6285-42aa-9f45-af2840476101 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:22.592944 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c2765-6285-42aa-9f45-af2840476101 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:22.593223 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c2765-6285-42aa-9f45-af2840476101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:22.594181 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:22.614852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-3a1c2765-6285-42aa-9f45-af2840476101 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:22.616863 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3a1c2765-6285-42aa-9f45-af2840476101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:22.684283 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68798f-154d-4506-9808-cf302d643bd6 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:22.691583 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1378/2755] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:22.701046 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b347cc-6d28-43db-b84b-66ea9480197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:22.702081 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b347cc-6d28-43db-b84b-66ea9480197f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:22.702465 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b347cc-6d28-43db-b84b-66ea9480197f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:22.702822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c2765-6285-42aa-9f45-af2840476101 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:22.702949 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b347cc-6d28-43db-b84b-66ea9480197f admin admin] PATH_INFO: `/v3/users/e48c4023554a4883a2a1a5f43e4deb45` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:22.704268 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b347cc-6d28-43db-b84b-66ea9480197f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48c4023554a4883a2a1a5f43e4deb45)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:22.707858 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-3a1c2765-6285-42aa-9f45-af2840476101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:22.707987 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b347cc-6d28-43db-b84b-66ea9480197f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:22.773777 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-85b347cc-6d28-43db-b84b-66ea9480197f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48c4023554a4883a2a1a5f43e4deb45'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:22.781992 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-85b347cc-6d28-43db-b84b-66ea9480197f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48c4023554a4883a2a1a5f43e4deb45'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:22.792636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-85b347cc-6d28-43db-b84b-66ea9480197f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48c4023554a4883a2a1a5f43e4deb45'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:22.793772 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-85b347cc-6d28-43db-b84b-66ea9480197f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48c4023554a4883a2a1a5f43e4deb45'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:22.794738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-85b347cc-6d28-43db-b84b-66ea9480197f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48c4023554a4883a2a1a5f43e4deb45'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:22.807181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c2765-6285-42aa-9f45-af2840476101 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:22.811670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc79f8e-4082-4793-ad19-25d35edcfe51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:22.812549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc79f8e-4082-4793-ad19-25d35edcfe51 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:22.812815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc79f8e-4082-4793-ad19-25d35edcfe51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:22.813198 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc79f8e-4082-4793-ad19-25d35edcfe51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:22.815826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ddc79f8e-4082-4793-ad19-25d35edcfe51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:22.819845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1378/2756] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:22 2022] DELETE /identity/v3/users/e48c4023554a4883a2a1a5f43e4deb45 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:18:22.824155 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fbc9d-423f-41e4-9591-43c30083cd4e None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:22.824599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fbc9d-423f-41e4-9591-43c30083cd4e None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:22.824979 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fbc9d-423f-41e4-9591-43c30083cd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:22.830401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc79f8e-4082-4793-ad19-25d35edcfe51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:22.832430 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc79f8e-4082-4793-ad19-25d35edcfe51 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:22.845585 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1379/2757] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:22.846811 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-5f3fbc9d-423f-41e4-9591-43c30083cd4e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:22.848017 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5f3fbc9d-423f-41e4-9591-43c30083cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:22.925095 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1379/2758] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:22.936247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc79f8e-4082-4793-ad19-25d35edcfe51 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:22.937730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ddc79f8e-4082-4793-ad19-25d35edcfe51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:22.952420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc79f8e-4082-4793-ad19-25d35edcfe51 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:23.025843 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c304a-b1a0-46bb-9343-4f448e595fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:23.026702 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c304a-b1a0-46bb-9343-4f448e595fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:23.027086 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c304a-b1a0-46bb-9343-4f448e595fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:23.027480 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c304a-b1a0-46bb-9343-4f448e595fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:23.040744 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c304a-b1a0-46bb-9343-4f448e595fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:23.042461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c304a-b1a0-46bb-9343-4f448e595fc0 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:23.055959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1380/2759] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:23.245323 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fbc9d-423f-41e4-9591-43c30083cd4e None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:23.247766 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-5f3fbc9d-423f-41e4-9591-43c30083cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:23.282493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fbc9d-423f-41e4-9591-43c30083cd4e None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:23.297384 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:23.310636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:23.313760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:23.314877 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] PATH_INFO: `/v3/projects/26cce676ded543dd90665a7ce5ae24f0` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:23.321174 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cce676ded543dd90665a7ce5ae24f0)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:23.323677 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:23.416637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c304a-b1a0-46bb-9343-4f448e595fc0 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:23.417014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cce676ded543dd90665a7ce5ae24f0', 'request_id': 'req-09bd37b5-e563-40cb-b356-c18cb31975c4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.419593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-074c304a-b1a0-46bb-9343-4f448e595fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:23.429500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cce676ded543dd90665a7ce5ae24f0', 'request_id': 'req-09bd37b5-e563-40cb-b356-c18cb31975c4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.437517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cce676ded543dd90665a7ce5ae24f0', 'request_id': 'req-09bd37b5-e563-40cb-b356-c18cb31975c4'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.449448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] The token cache is being invalidate because project 26cce676ded543dd90665a7ce5ae24f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:23.449448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.450328 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.452026 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1380/2760] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:23 2022] DELETE /identity/v3/projects/26cce676ded543dd90665a7ce5ae24f0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:23.456878 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:23.458474 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:23.459508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c304a-b1a0-46bb-9343-4f448e595fc0 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:23.532517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd37b5-e563-40cb-b356-c18cb31975c4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:23.537514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:23.538966 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:23.539252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:23.539527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] PATH_INFO: `/v3/users/6644897522e4450d9d0a771a1e24a761` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:23.540955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=6644897522e4450d9d0a771a1e24a761)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:23.542892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:23.567165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:23.568064 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:23.568401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:23.568680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] PATH_INFO: `/v3/projects/0f1cdfcf96d04805bc9af76348b3ff08` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:23.569917 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1cdfcf96d04805bc9af76348b3ff08)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:23.571925 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:23.599254 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6644897522e4450d9d0a771a1e24a761'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.612898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6644897522e4450d9d0a771a1e24a761'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.624652 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6644897522e4450d9d0a771a1e24a761'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.625394 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6644897522e4450d9d0a771a1e24a761'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.626174 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6644897522e4450d9d0a771a1e24a761'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.636753 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1cdfcf96d04805bc9af76348b3ff08', 'request_id': 'req-a4b3441a-2fd2-4203-a2a9-70cbe4767182'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.643735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1cdfcf96d04805bc9af76348b3ff08', 'request_id': 'req-a4b3441a-2fd2-4203-a2a9-70cbe4767182'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.650130 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1cdfcf96d04805bc9af76348b3ff08', 'request_id': 'req-a4b3441a-2fd2-4203-a2a9-70cbe4767182'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.652261 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1381/2761] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:23 2022] DELETE /identity/v3/users/6644897522e4450d9d0a771a1e24a761 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:18:23.666216 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] The token cache is being invalidate because project 0f1cdfcf96d04805bc9af76348b3ff08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:23.666916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.667888 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.669690 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1381/2762] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:23 2022] DELETE /identity/v3/projects/0f1cdfcf96d04805bc9af76348b3ff08 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:23.674400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:23.675992 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:23.758000 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34a62-e96a-4aa8-9bf8-3fad4e3ac3ac admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:23.764514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679da23-4cba-4cf5-8f12-a501bcd28f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:23.765826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679da23-4cba-4cf5-8f12-a501bcd28f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:23.766592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679da23-4cba-4cf5-8f12-a501bcd28f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:23.767194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679da23-4cba-4cf5-8f12-a501bcd28f68 admin admin] PATH_INFO: `/v3/users/72aa05a333cc43299a8865ab95761620` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:23.769631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679da23-4cba-4cf5-8f12-a501bcd28f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72aa05a333cc43299a8865ab95761620)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:23.771748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679da23-4cba-4cf5-8f12-a501bcd28f68 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:23.837798 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5679da23-4cba-4cf5-8f12-a501bcd28f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72aa05a333cc43299a8865ab95761620'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.846269 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5679da23-4cba-4cf5-8f12-a501bcd28f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72aa05a333cc43299a8865ab95761620'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.857285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5679da23-4cba-4cf5-8f12-a501bcd28f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72aa05a333cc43299a8865ab95761620'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.857986 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5679da23-4cba-4cf5-8f12-a501bcd28f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72aa05a333cc43299a8865ab95761620'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.858670 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-5679da23-4cba-4cf5-8f12-a501bcd28f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72aa05a333cc43299a8865ab95761620'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:23.878736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1382/2763] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:23 2022] DELETE /identity/v3/users/72aa05a333cc43299a8865ab95761620 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:23.971062 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:23.972540 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:24.082428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3441a-2fd2-4203-a2a9-70cbe4767182 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.165178 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:24.166742 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.167232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.168287 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] PATH_INFO: `/v3/projects/9424dd5431ba418db3519ffe648ac3d4` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.169738 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9424dd5431ba418db3519ffe648ac3d4)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:24.171870 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:24.230443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9424dd5431ba418db3519ffe648ac3d4', 'request_id': 'req-b4e83a43-1e34-45c0-865a-96996aa3821c'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:24.237201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9424dd5431ba418db3519ffe648ac3d4', 'request_id': 'req-b4e83a43-1e34-45c0-865a-96996aa3821c'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:24.243785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9424dd5431ba418db3519ffe648ac3d4', 'request_id': 'req-b4e83a43-1e34-45c0-865a-96996aa3821c'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:24.270402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] The token cache is being invalidate because project 9424dd5431ba418db3519ffe648ac3d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:24.270883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:24.277182 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:24.279159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1382/2764] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:23 2022] DELETE /identity/v3/projects/9424dd5431ba418db3519ffe648ac3d4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:24.284501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8460a-1e6b-4f31-8056-9404c9431bd1 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.284826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8460a-1e6b-4f31-8056-9404c9431bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.285202 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8460a-1e6b-4f31-8056-9404c9431bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.298659 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:24.302767 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:24.326908 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-6df8460a-1e6b-4f31-8056-9404c9431bd1 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:24.328363 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-6df8460a-1e6b-4f31-8056-9404c9431bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:24.411522 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e83a43-1e34-45c0-865a-96996aa3821c admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.419821 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:24.421987 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1383/2765] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:24.428449 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.428852 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.429250 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] PATH_INFO: `/v3/projects/22ba3fa224554849b10e99a5bb3421fa` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.430102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867fa78-5cbd-4774-8621-72a6862b1b70 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.430399 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867fa78-5cbd-4774-8621-72a6862b1b70 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.430680 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867fa78-5cbd-4774-8621-72a6862b1b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.431550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ba3fa224554849b10e99a5bb3421fa)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:24.433734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:24.454117 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-d867fa78-5cbd-4774-8621-72a6862b1b70 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:24.455320 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d867fa78-5cbd-4774-8621-72a6862b1b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:24.469280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1384/2766] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:24.470545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867fa78-5cbd-4774-8621-72a6862b1b70 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:24.481617 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867fa78-5cbd-4774-8621-72a6862b1b70 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.498830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ba3fa224554849b10e99a5bb3421fa', 'request_id': 'req-2d51f4c7-9963-4adb-b319-3b90ee9735ae'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:24.509794 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ba3fa224554849b10e99a5bb3421fa', 'request_id': 'req-2d51f4c7-9963-4adb-b319-3b90ee9735ae'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:24.517949 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ba3fa224554849b10e99a5bb3421fa', 'request_id': 'req-2d51f4c7-9963-4adb-b319-3b90ee9735ae'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:24.546867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069578e-70a6-4f6f-9d6e-38d58faacdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:24.546867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069578e-70a6-4f6f-9d6e-38d58faacdfa admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.546867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069578e-70a6-4f6f-9d6e-38d58faacdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.546867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069578e-70a6-4f6f-9d6e-38d58faacdfa admin admin] PATH_INFO: `/v3/domains` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.547788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069578e-70a6-4f6f-9d6e-38d58faacdfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79871) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:18:24.547788 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069578e-70a6-4f6f-9d6e-38d58faacdfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:24.548479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069578e-70a6-4f6f-9d6e-38d58faacdfa admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:24.550731 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] The token cache is being invalidate because project 22ba3fa224554849b10e99a5bb3421fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:24.551227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:24.552405 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2d51f4c7-9963-4adb-b319-3b90ee9735ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:24.554815 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1383/2767] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:24 2022] DELETE /identity/v3/projects/22ba3fa224554849b10e99a5bb3421fa => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:24.560172 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2bfb3-037a-4c2c-baa7-708b9a0a2797 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.560771 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2bfb3-037a-4c2c-baa7-708b9a0a2797 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.561421 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2bfb3-037a-4c2c-baa7-708b9a0a2797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.565862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1385/2768] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:18:24.566832 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069578e-70a6-4f6f-9d6e-38d58faacdfa admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:24.569012 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2069578e-70a6-4f6f-9d6e-38d58faacdfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:24.585951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-abd2bfb3-037a-4c2c-baa7-708b9a0a2797 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:24.587696 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-abd2bfb3-037a-4c2c-baa7-708b9a0a2797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:24.588606 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069578e-70a6-4f6f-9d6e-38d58faacdfa admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.594148 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdef2d-77de-47a4-a137-a7b7aeff9e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:24.595010 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdef2d-77de-47a4-a137-a7b7aeff9e36 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.595428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdef2d-77de-47a4-a137-a7b7aeff9e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.595536 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdef2d-77de-47a4-a137-a7b7aeff9e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.596310 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdef2d-77de-47a4-a137-a7b7aeff9e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:24.598291 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdef2d-77de-47a4-a137-a7b7aeff9e36 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:24.599913 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1384/2769] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:24.608261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60445e1-c342-4bde-aca7-24c3b2af89bf None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.608562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60445e1-c342-4bde-aca7-24c3b2af89bf None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.608847 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60445e1-c342-4bde-aca7-24c3b2af89bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.638038 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1386/2770] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:24 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:24.638420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-f60445e1-c342-4bde-aca7-24c3b2af89bf None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:24.639763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-f60445e1-c342-4bde-aca7-24c3b2af89bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:24.642133 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdef2d-77de-47a4-a137-a7b7aeff9e36 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:24.725235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1385/2771] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:24.727297 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60445e1-c342-4bde-aca7-24c3b2af89bf None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:24.735820 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdef2d-77de-47a4-a137-a7b7aeff9e36 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.741456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada330a4-92cb-43f1-a386-02cdf5de928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:24.742321 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada330a4-92cb-43f1-a386-02cdf5de928a admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.742608 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada330a4-92cb-43f1-a386-02cdf5de928a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.742889 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada330a4-92cb-43f1-a386-02cdf5de928a admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.743582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada330a4-92cb-43f1-a386-02cdf5de928a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:24.744383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60445e1-c342-4bde-aca7-24c3b2af89bf None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.745675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada330a4-92cb-43f1-a386-02cdf5de928a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:24.749593 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7497-0717-4f24-94d6-2f008697267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:24.750486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7497-0717-4f24-94d6-2f008697267e admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.750923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7497-0717-4f24-94d6-2f008697267e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.751365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7497-0717-4f24-94d6-2f008697267e admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.752535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7497-0717-4f24-94d6-2f008697267e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:18:24.753007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7497-0717-4f24-94d6-2f008697267e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:24.756051 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7497-0717-4f24-94d6-2f008697267e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:24.771177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1387/2772] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:24 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:18:24.772286 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada330a4-92cb-43f1-a386-02cdf5de928a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:24.779197 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1386/2773] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:18:24.780517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7497-0717-4f24-94d6-2f008697267e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:24.784238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada330a4-92cb-43f1-a386-02cdf5de928a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.792151 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7497-0717-4f24-94d6-2f008697267e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.793797 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67412824-8f21-4930-8705-69626915d7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:24.794455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67412824-8f21-4930-8705-69626915d7ce admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.794741 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67412824-8f21-4930-8705-69626915d7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.795016 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67412824-8f21-4930-8705-69626915d7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.795779 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67412824-8f21-4930-8705-69626915d7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:24.797429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67412824-8f21-4930-8705-69626915d7ce admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:24.798438 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193bf45-05a7-490a-b129-9e2fc08f898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:24.799418 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193bf45-05a7-490a-b129-9e2fc08f898a admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.799903 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193bf45-05a7-490a-b129-9e2fc08f898a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.800205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193bf45-05a7-490a-b129-9e2fc08f898a admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.800911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193bf45-05a7-490a-b129-9e2fc08f898a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:24.802802 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193bf45-05a7-490a-b129-9e2fc08f898a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:24.810361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1388/2774] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 12:18:24.817065 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67412824-8f21-4930-8705-69626915d7ce admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:24.828069 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67412824-8f21-4930-8705-69626915d7ce admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.833320 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9857-35ae-4aad-9eae-e81350ee4fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:24.834050 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9857-35ae-4aad-9eae-e81350ee4fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.834340 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9857-35ae-4aad-9eae-e81350ee4fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.834606 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9857-35ae-4aad-9eae-e81350ee4fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.835601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e9857-35ae-4aad-9eae-e81350ee4fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:24.837456 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e9857-35ae-4aad-9eae-e81350ee4fe4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:24.840004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1387/2775] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:24 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:24.844442 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193bf45-05a7-490a-b129-9e2fc08f898a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:24.849606 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1389/2776] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:24.855929 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9857-35ae-4aad-9eae-e81350ee4fe4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:24.874203 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9857-35ae-4aad-9eae-e81350ee4fe4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.928977 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193bf45-05a7-490a-b129-9e2fc08f898a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.934590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee245e49-cd19-445f-b378-8265f515df40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:24.935269 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee245e49-cd19-445f-b378-8265f515df40 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.935706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee245e49-cd19-445f-b378-8265f515df40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.935991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee245e49-cd19-445f-b378-8265f515df40 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.936719 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee245e49-cd19-445f-b378-8265f515df40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:24.937904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6160be-10f5-4aa8-9c17-72f3611d13b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:24.938746 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee245e49-cd19-445f-b378-8265f515df40 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:24.938864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6160be-10f5-4aa8-9c17-72f3611d13b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.939290 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6160be-10f5-4aa8-9c17-72f3611d13b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.939629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6160be-10f5-4aa8-9c17-72f3611d13b9 admin admin] PATH_INFO: `/v3/projects/5b6b99f9edb3412893af3df914662e54/users/6920b81028b0426786118de630012c60/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:24.959199 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6160be-10f5-4aa8-9c17-72f3611d13b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6b99f9edb3412893af3df914662e54, user_id=6920b81028b0426786118de630012c60, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:24.963354 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6160be-10f5-4aa8-9c17-72f3611d13b9 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:24.966775 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1388/2777] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:24 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:24.968026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee245e49-cd19-445f-b378-8265f515df40 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:24.980020 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1390/2778] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:24 2022] PUT /identity/v3/projects/5b6b99f9edb3412893af3df914662e54/users/6920b81028b0426786118de630012c60/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:18:24.984385 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee245e49-cd19-445f-b378-8265f515df40 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:24.992312 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3dc2d-9c7b-4064-a622-0c88e991ba38 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:24.992871 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3dc2d-9c7b-4064-a622-0c88e991ba38 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:24.993019 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3dc2d-9c7b-4064-a622-0c88e991ba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.026090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-aad3dc2d-9c7b-4064-a622-0c88e991ba38 None None] MFA Rules not processed for user `6920b81028b0426786118de630012c60`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:25.027431 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-aad3dc2d-9c7b-4064-a622-0c88e991ba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:25.069013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd1960-1778-4195-aa0b-975b35fecba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:25.070535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd1960-1778-4195-aa0b-975b35fecba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.070898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd1960-1778-4195-aa0b-975b35fecba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.071248 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd1960-1778-4195-aa0b-975b35fecba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.072311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd1960-1778-4195-aa0b-975b35fecba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:25.074454 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd1960-1778-4195-aa0b-975b35fecba6 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:25.086921 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1389/2779] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:25.091368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd1960-1778-4195-aa0b-975b35fecba6 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:25.101994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd1960-1778-4195-aa0b-975b35fecba6 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:25.107483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648bbc5-afb9-419f-9e1e-c94acd02e1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:25.108319 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1391/2780] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:25.108595 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648bbc5-afb9-419f-9e1e-c94acd02e1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.108952 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648bbc5-afb9-419f-9e1e-c94acd02e1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.109289 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648bbc5-afb9-419f-9e1e-c94acd02e1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.110084 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648bbc5-afb9-419f-9e1e-c94acd02e1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:25.112982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4648bbc5-afb9-419f-9e1e-c94acd02e1d0 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:25.124279 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3dc2d-9c7b-4064-a622-0c88e991ba38 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:25.126184 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-aad3dc2d-9c7b-4064-a622-0c88e991ba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:25.129118 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1390/2781] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:25.133171 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648bbc5-afb9-419f-9e1e-c94acd02e1d0 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:25.148420 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648bbc5-afb9-419f-9e1e-c94acd02e1d0 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:25.154322 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a815d8-55da-4f70-85b4-b1e0e370b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:25.155483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a815d8-55da-4f70-85b4-b1e0e370b754 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.155958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a815d8-55da-4f70-85b4-b1e0e370b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.156549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a815d8-55da-4f70-85b4-b1e0e370b754 admin admin] PATH_INFO: `/v3/projects/cc7f1064b3d94574aed6d28f0d23132c/users/8d52ac2e37ef44138641ebdffc396ff9/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.177679 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a815d8-55da-4f70-85b4-b1e0e370b754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc7f1064b3d94574aed6d28f0d23132c, user_id=8d52ac2e37ef44138641ebdffc396ff9, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:25.182351 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a815d8-55da-4f70-85b4-b1e0e370b754 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:25.201873 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1391/2782] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:25 2022] PUT /identity/v3/projects/cc7f1064b3d94574aed6d28f0d23132c/users/8d52ac2e37ef44138641ebdffc396ff9/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:25.213080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefbd82-0362-461b-9999-c2d4ea3bea5b None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.213513 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefbd82-0362-461b-9999-c2d4ea3bea5b None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.213882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefbd82-0362-461b-9999-c2d4ea3bea5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.215785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3dc2d-9c7b-4064-a622-0c88e991ba38 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:25.245621 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1cefbd82-0362-461b-9999-c2d4ea3bea5b None None] MFA Rules not processed for user `8d52ac2e37ef44138641ebdffc396ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:25.246848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1cefbd82-0362-461b-9999-c2d4ea3bea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:25.281040 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cfa53-ecc2-45ac-8b76-213d06819ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:25.283159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cfa53-ecc2-45ac-8b76-213d06819ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.283459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cfa53-ecc2-45ac-8b76-213d06819ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.283738 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cfa53-ecc2-45ac-8b76-213d06819ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.335861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1392/2783] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:25.337270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefbd82-0362-461b-9999-c2d4ea3bea5b None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:25.364227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cfa53-ecc2-45ac-8b76-213d06819ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:25.364227 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cfa53-ecc2-45ac-8b76-213d06819ae5 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:25.380228 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1392/2784] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 12:18:25.426150 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefbd82-0362-461b-9999-c2d4ea3bea5b None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:25.432649 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ecc86-5e2b-4986-b235-0ba0cc59fc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:25.433339 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ecc86-5e2b-4986-b235-0ba0cc59fc7e admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.433674 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ecc86-5e2b-4986-b235-0ba0cc59fc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.433958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ecc86-5e2b-4986-b235-0ba0cc59fc7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.434661 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ecc86-5e2b-4986-b235-0ba0cc59fc7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:25.436760 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ecc86-5e2b-4986-b235-0ba0cc59fc7e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:25.474368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1393/2785] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:25 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:25.487298 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cfa53-ecc2-45ac-8b76-213d06819ae5 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:25.525362 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cfa53-ecc2-45ac-8b76-213d06819ae5 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:25.610578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adeb8a-adb2-404f-a78a-613c10c9a645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:25.612099 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adeb8a-adb2-404f-a78a-613c10c9a645 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.612641 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adeb8a-adb2-404f-a78a-613c10c9a645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.613517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adeb8a-adb2-404f-a78a-613c10c9a645 admin admin] PATH_INFO: `/v3/users` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.614526 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adeb8a-adb2-404f-a78a-613c10c9a645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:25.618158 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adeb8a-adb2-404f-a78a-613c10c9a645 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:25.645496 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1393/2786] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:25 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:25.650653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ecc86-5e2b-4986-b235-0ba0cc59fc7e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:25.665990 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ecc86-5e2b-4986-b235-0ba0cc59fc7e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:25.681982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e713cb-161b-489e-959e-bc8e00c96bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:25.681982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e713cb-161b-489e-959e-bc8e00c96bba admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.681982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e713cb-161b-489e-959e-bc8e00c96bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.681982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e713cb-161b-489e-959e-bc8e00c96bba admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.682462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e713cb-161b-489e-959e-bc8e00c96bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:25.683772 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e713cb-161b-489e-959e-bc8e00c96bba admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:25.706809 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1394/2787] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:25.710562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adeb8a-adb2-404f-a78a-613c10c9a645 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:25.726497 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adeb8a-adb2-404f-a78a-613c10c9a645 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:25.737166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51f34b-0ad7-4012-a02b-c0f4946d5f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:25.738132 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51f34b-0ad7-4012-a02b-c0f4946d5f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.738429 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51f34b-0ad7-4012-a02b-c0f4946d5f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.738734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51f34b-0ad7-4012-a02b-c0f4946d5f72 admin admin] PATH_INFO: `/v3/projects/d26ad6c9e896488f8d3dbc9bccdf9e7d/users/2028eb6b1fd0460d8022f0e9fc41cd88/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.777925 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51f34b-0ad7-4012-a02b-c0f4946d5f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26ad6c9e896488f8d3dbc9bccdf9e7d, user_id=2028eb6b1fd0460d8022f0e9fc41cd88, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:25.780638 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51f34b-0ad7-4012-a02b-c0f4946d5f72 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:25.798850 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1394/2788] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:25 2022] PUT /identity/v3/projects/d26ad6c9e896488f8d3dbc9bccdf9e7d/users/2028eb6b1fd0460d8022f0e9fc41cd88/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:25.802550 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e713cb-161b-489e-959e-bc8e00c96bba admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:25.814530 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e713cb-161b-489e-959e-bc8e00c96bba admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:25.877698 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f8b85-b393-469a-9db9-c5297a0a0352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:25.878286 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f8b85-b393-469a-9db9-c5297a0a0352 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.878557 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f8b85-b393-469a-9db9-c5297a0a0352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.878837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f8b85-b393-469a-9db9-c5297a0a0352 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.879571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f8b85-b393-469a-9db9-c5297a0a0352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:25.881204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f8b85-b393-469a-9db9-c5297a0a0352 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:25.892730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1395/2789] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:25.897732 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51f34b-0ad7-4012-a02b-c0f4946d5f72 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:25.908599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51f34b-0ad7-4012-a02b-c0f4946d5f72 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:25.913674 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9a7c3-ecb7-4299-8976-cca6a63744d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:25.914711 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9a7c3-ecb7-4299-8976-cca6a63744d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.915581 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9a7c3-ecb7-4299-8976-cca6a63744d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.915947 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9a7c3-ecb7-4299-8976-cca6a63744d4 admin admin] PATH_INFO: `/v3/projects/d26ad6c9e896488f8d3dbc9bccdf9e7d/users/2028eb6b1fd0460d8022f0e9fc41cd88/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.918068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9a7c3-ecb7-4299-8976-cca6a63744d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26ad6c9e896488f8d3dbc9bccdf9e7d, user_id=2028eb6b1fd0460d8022f0e9fc41cd88, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:25.920831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9a7c3-ecb7-4299-8976-cca6a63744d4 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:25.932161 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1395/2790] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:25 2022] PUT /identity/v3/projects/d26ad6c9e896488f8d3dbc9bccdf9e7d/users/2028eb6b1fd0460d8022f0e9fc41cd88/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:25.943117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1180196-6696-4bc8-b05b-6d51f7fd00fe None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:25.943484 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1180196-6696-4bc8-b05b-6d51f7fd00fe None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:25.943833 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1180196-6696-4bc8-b05b-6d51f7fd00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:25.971734 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-b1180196-6696-4bc8-b05b-6d51f7fd00fe None None] MFA Rules not processed for user `2028eb6b1fd0460d8022f0e9fc41cd88`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:25.972973 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b1180196-6696-4bc8-b05b-6d51f7fd00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:26.040142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1396/2791] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:26.055543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9a7c3-ecb7-4299-8976-cca6a63744d4 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:26.119880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9a7c3-ecb7-4299-8976-cca6a63744d4 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:26.125032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ed999-6651-4e61-8a49-2a8921279501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:26.126036 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ed999-6651-4e61-8a49-2a8921279501 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:26.126510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ed999-6651-4e61-8a49-2a8921279501 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:26.127002 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ed999-6651-4e61-8a49-2a8921279501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:26.139294 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ed999-6651-4e61-8a49-2a8921279501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:26.141443 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ed999-6651-4e61-8a49-2a8921279501 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:26.157043 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1396/2792] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:26.910827 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1180196-6696-4bc8-b05b-6d51f7fd00fe None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:27.001883 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1180196-6696-4bc8-b05b-6d51f7fd00fe None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:27.010523 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:27.011944 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:27.012427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:27.012937 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] PATH_INFO: `/v3/users/8d52ac2e37ef44138641ebdffc396ff9` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:27.015261 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d52ac2e37ef44138641ebdffc396ff9)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:27.018838 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:27.108336 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d52ac2e37ef44138641ebdffc396ff9'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:27.110739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d52ac2e37ef44138641ebdffc396ff9'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:27.118046 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d52ac2e37ef44138641ebdffc396ff9'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:27.127436 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d52ac2e37ef44138641ebdffc396ff9'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:27.127658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d52ac2e37ef44138641ebdffc396ff9'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:27.149069 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1397/2793] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:26 2022] DELETE /identity/v3/users/8d52ac2e37ef44138641ebdffc396ff9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:18:27.155232 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e79cfc-7c9d-4d29-b165-2d0257c1f3a4 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:27.155733 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e79cfc-7c9d-4d29-b165-2d0257c1f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:27.155864 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e79cfc-7c9d-4d29-b165-2d0257c1f3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:27.182831 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-55e79cfc-7c9d-4d29-b165-2d0257c1f3a4 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:27.184827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-55e79cfc-7c9d-4d29-b165-2d0257c1f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:27.265588 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1397/2794] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:27.276950 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:27.278400 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:27.351579 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb83adc-8178-4db5-aca5-45cb4d534e46 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:27.355854 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076af08-036d-4be1-a8a6-7b9e02fbd151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:27.357065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076af08-036d-4be1-a8a6-7b9e02fbd151 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:27.358402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076af08-036d-4be1-a8a6-7b9e02fbd151 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:27.358756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076af08-036d-4be1-a8a6-7b9e02fbd151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:27.373558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076af08-036d-4be1-a8a6-7b9e02fbd151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:27.375694 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076af08-036d-4be1-a8a6-7b9e02fbd151 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:27.391630 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1398/2795] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:27.729695 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e79cfc-7c9d-4d29-b165-2d0257c1f3a4 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:27.731136 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-55e79cfc-7c9d-4d29-b165-2d0257c1f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:27.757543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e79cfc-7c9d-4d29-b165-2d0257c1f3a4 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:27.766948 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:27.767827 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:27.768110 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:27.768421 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] PATH_INFO: `/v3/projects/cc7f1064b3d94574aed6d28f0d23132c` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:27.769630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc7f1064b3d94574aed6d28f0d23132c)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:27.771562 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:27.823359 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc7f1064b3d94574aed6d28f0d23132c', 'request_id': 'req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:27.835318 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc7f1064b3d94574aed6d28f0d23132c', 'request_id': 'req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:27.842813 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc7f1064b3d94574aed6d28f0d23132c', 'request_id': 'req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:27.855064 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] The token cache is being invalidate because project cc7f1064b3d94574aed6d28f0d23132c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:27.855528 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:27.856305 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:27.858176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1398/2796] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:27 2022] DELETE /identity/v3/projects/cc7f1064b3d94574aed6d28f0d23132c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:27.862253 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076af08-036d-4be1-a8a6-7b9e02fbd151 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:27.872985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076af08-036d-4be1-a8a6-7b9e02fbd151 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:27.932100 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de8622-0e91-4b82-b5a1-3df879ba52f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:27.933169 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de8622-0e91-4b82-b5a1-3df879ba52f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:27.933561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de8622-0e91-4b82-b5a1-3df879ba52f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:27.933947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de8622-0e91-4b82-b5a1-3df879ba52f0 admin admin] PATH_INFO: `/v3/users/2028eb6b1fd0460d8022f0e9fc41cd88` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:27.935301 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de8622-0e91-4b82-b5a1-3df879ba52f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2028eb6b1fd0460d8022f0e9fc41cd88)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:27.937401 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de8622-0e91-4b82-b5a1-3df879ba52f0 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:27.999998 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b1de8622-0e91-4b82-b5a1-3df879ba52f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2028eb6b1fd0460d8022f0e9fc41cd88'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:28.000730 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b1de8622-0e91-4b82-b5a1-3df879ba52f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2028eb6b1fd0460d8022f0e9fc41cd88'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:28.010966 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b1de8622-0e91-4b82-b5a1-3df879ba52f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2028eb6b1fd0460d8022f0e9fc41cd88'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:28.021237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b1de8622-0e91-4b82-b5a1-3df879ba52f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2028eb6b1fd0460d8022f0e9fc41cd88'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:28.022676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-b1de8622-0e91-4b82-b5a1-3df879ba52f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2028eb6b1fd0460d8022f0e9fc41cd88'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:28.043343 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1399/2797] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:27 2022] DELETE /identity/v3/users/2028eb6b1fd0460d8022f0e9fc41cd88 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:28.371255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:28.373267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:28.391143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e40e0-41ef-464c-a51a-4a52d09ae8d9 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:28.451402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:28.452314 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:28.452601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:28.452876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] PATH_INFO: `/v3/projects/d26ad6c9e896488f8d3dbc9bccdf9e7d` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:28.454210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26ad6c9e896488f8d3dbc9bccdf9e7d)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:28.456127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:28.523548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26ad6c9e896488f8d3dbc9bccdf9e7d', 'request_id': 'req-b8c63a62-52dc-4aff-b74e-f404882ee42a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:28.534668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26ad6c9e896488f8d3dbc9bccdf9e7d', 'request_id': 'req-b8c63a62-52dc-4aff-b74e-f404882ee42a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:28.542505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26ad6c9e896488f8d3dbc9bccdf9e7d', 'request_id': 'req-b8c63a62-52dc-4aff-b74e-f404882ee42a'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:28.553210 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] The token cache is being invalidate because project d26ad6c9e896488f8d3dbc9bccdf9e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:28.554190 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:28.557636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:28.557636 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1399/2798] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:28 2022] DELETE /identity/v3/projects/d26ad6c9e896488f8d3dbc9bccdf9e7d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:38.097071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef33ba1-7ec7-4032-a611-925f7966ab81 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:38.097602 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef33ba1-7ec7-4032-a611-925f7966ab81 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:38.097718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef33ba1-7ec7-4032-a611-925f7966ab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:38.114935 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-9ef33ba1-7ec7-4032-a611-925f7966ab81 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:38.116902 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9ef33ba1-7ec7-4032-a611-925f7966ab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:38.172991 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1400/2799] 10.222.0.58 () {58 vars in 967 bytes} [Tue May 17 12:18:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:38.187120 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:38.188622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:38.255715 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c63a62-52dc-4aff-b74e-f404882ee42a admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:38.260628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc095b14-b306-4b94-b91e-03bd82681747 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:38.261263 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc095b14-b306-4b94-b91e-03bd82681747 service swift] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:38.261545 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc095b14-b306-4b94-b91e-03bd82681747 service swift] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:38.261821 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc095b14-b306-4b94-b91e-03bd82681747 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:38.269600 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc095b14-b306-4b94-b91e-03bd82681747 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:38.271159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc095b14-b306-4b94-b91e-03bd82681747 service swift] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:38.279014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1400/2800] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:18:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 12:18:40.197239 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef33ba1-7ec7-4032-a611-925f7966ab81 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:40.198657 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9ef33ba1-7ec7-4032-a611-925f7966ab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:40.262685 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef33ba1-7ec7-4032-a611-925f7966ab81 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:40.267310 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec38d8-6952-45c8-b415-64b03f8bdf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:40.268171 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec38d8-6952-45c8-b415-64b03f8bdf34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:40.268482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec38d8-6952-45c8-b415-64b03f8bdf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:40.268751 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec38d8-6952-45c8-b415-64b03f8bdf34 admin admin] PATH_INFO: `/v3/users/291b520eed8f446b86296165fb5d658a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:40.269934 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec38d8-6952-45c8-b415-64b03f8bdf34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=291b520eed8f446b86296165fb5d658a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:40.272455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec38d8-6952-45c8-b415-64b03f8bdf34 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:40.316160 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8fec38d8-6952-45c8-b415-64b03f8bdf34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291b520eed8f446b86296165fb5d658a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:40.316762 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8fec38d8-6952-45c8-b415-64b03f8bdf34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291b520eed8f446b86296165fb5d658a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:40.323558 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8fec38d8-6952-45c8-b415-64b03f8bdf34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291b520eed8f446b86296165fb5d658a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:40.332008 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8fec38d8-6952-45c8-b415-64b03f8bdf34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291b520eed8f446b86296165fb5d658a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:40.332676 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-8fec38d8-6952-45c8-b415-64b03f8bdf34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291b520eed8f446b86296165fb5d658a'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:40.349735 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1401/2801] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:40 2022] DELETE /identity/v3/users/291b520eed8f446b86296165fb5d658a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:40.523140 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc095b14-b306-4b94-b91e-03bd82681747 service swift] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:40.581582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc095b14-b306-4b94-b91e-03bd82681747 service swift] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:40.634138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:40.634981 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:40.635257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:40.635529 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] PATH_INFO: `/v3/projects/f55775e2790046029256efb09b501c89` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:40.636762 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55775e2790046029256efb09b501c89)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:40.638643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:40.684550 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55775e2790046029256efb09b501c89', 'request_id': 'req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:40.691742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55775e2790046029256efb09b501c89', 'request_id': 'req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:40.698433 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55775e2790046029256efb09b501c89', 'request_id': 'req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:40.720554 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] The token cache is being invalidate because project f55775e2790046029256efb09b501c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:40.720841 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:40.721463 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c2c27c00-9f9b-4563-a281-b06e03a6a8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:40.722999 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1401/2802] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:40 2022] DELETE /identity/v3/projects/f55775e2790046029256efb09b501c89 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:40.728334 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79ed7c-83ff-49d9-9d96-b0cff2d5960c None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:40.728625 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79ed7c-83ff-49d9-9d96-b0cff2d5960c None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:40.728899 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79ed7c-83ff-49d9-9d96-b0cff2d5960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:40.764993 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-9a79ed7c-83ff-49d9-9d96-b0cff2d5960c None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:40.766173 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-9a79ed7c-83ff-49d9-9d96-b0cff2d5960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:40.823620 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1402/2803] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:40.831566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84210d43-3f16-46fb-a402-febcee7b0f75 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:40.831901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84210d43-3f16-46fb-a402-febcee7b0f75 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:40.832128 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84210d43-3f16-46fb-a402-febcee7b0f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:40.851013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-84210d43-3f16-46fb-a402-febcee7b0f75 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:40.852271 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-84210d43-3f16-46fb-a402-febcee7b0f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:40.860021 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1402/2804] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:40.864137 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79ed7c-83ff-49d9-9d96-b0cff2d5960c None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:40.874496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79ed7c-83ff-49d9-9d96-b0cff2d5960c None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:40.879566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6ebd0-1252-4ff7-bd47-e55f52d1f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:40.880252 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ebd0-1252-4ff7-bd47-e55f52d1f547 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:40.880542 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ebd0-1252-4ff7-bd47-e55f52d1f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:40.880822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ebd0-1252-4ff7-bd47-e55f52d1f547 admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:40.881560 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6ebd0-1252-4ff7-bd47-e55f52d1f547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:18:40.881895 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6ebd0-1252-4ff7-bd47-e55f52d1f547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:40.883534 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6ebd0-1252-4ff7-bd47-e55f52d1f547 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:40.900342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1403/2805] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:18:40.901499 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84210d43-3f16-46fb-a402-febcee7b0f75 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:40.910679 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84210d43-3f16-46fb-a402-febcee7b0f75 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:40.915974 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee4092-123d-44d0-a431-f80dd94c18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:40.916650 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4092-123d-44d0-a431-f80dd94c18b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:40.916930 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4092-123d-44d0-a431-f80dd94c18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:40.917201 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee4092-123d-44d0-a431-f80dd94c18b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:40.917880 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee4092-123d-44d0-a431-f80dd94c18b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:40.919771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee4092-123d-44d0-a431-f80dd94c18b9 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:40.944964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1403/2806] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:40 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:18:40.949046 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6ebd0-1252-4ff7-bd47-e55f52d1f547 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:40.959046 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6ebd0-1252-4ff7-bd47-e55f52d1f547 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:41.014764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138fbc7-70cf-4903-8913-8618a53f6ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:41.015435 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138fbc7-70cf-4903-8913-8618a53f6ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:41.015726 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138fbc7-70cf-4903-8913-8618a53f6ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:41.016007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138fbc7-70cf-4903-8913-8618a53f6ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:41.016733 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138fbc7-70cf-4903-8913-8618a53f6ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:41.018636 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138fbc7-70cf-4903-8913-8618a53f6ea4 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:41.040302 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1404/2807] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:40 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:18:41.043763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee4092-123d-44d0-a431-f80dd94c18b9 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:41.054252 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee4092-123d-44d0-a431-f80dd94c18b9 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:41.058890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb76a7f-878d-488f-97db-fea1d0f4b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:41.059543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb76a7f-878d-488f-97db-fea1d0f4b7aa admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:41.059825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb76a7f-878d-488f-97db-fea1d0f4b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:41.060102 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb76a7f-878d-488f-97db-fea1d0f4b7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:41.060862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb76a7f-878d-488f-97db-fea1d0f4b7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:41.062455 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb76a7f-878d-488f-97db-fea1d0f4b7aa admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:41.072522 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1404/2808] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:41.076464 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138fbc7-70cf-4903-8913-8618a53f6ea4 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:41.086790 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138fbc7-70cf-4903-8913-8618a53f6ea4 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:41.091317 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e46ab-1afc-4012-8c96-a0232c4aae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:41.091959 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e46ab-1afc-4012-8c96-a0232c4aae9c admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:41.092275 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e46ab-1afc-4012-8c96-a0232c4aae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:41.092552 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e46ab-1afc-4012-8c96-a0232c4aae9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:41.093266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e46ab-1afc-4012-8c96-a0232c4aae9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:41.094837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e46ab-1afc-4012-8c96-a0232c4aae9c admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:41.106923 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1405/2809] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:41.110915 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb76a7f-878d-488f-97db-fea1d0f4b7aa admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:41.120645 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb76a7f-878d-488f-97db-fea1d0f4b7aa admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:41.125177 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50126d3-7015-4e77-a0b7-9b8c3e530578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:41.126032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50126d3-7015-4e77-a0b7-9b8c3e530578 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:41.126308 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50126d3-7015-4e77-a0b7-9b8c3e530578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:41.126578 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50126d3-7015-4e77-a0b7-9b8c3e530578 admin admin] PATH_INFO: `/v3/projects/82004674fb2b4ea49a63ee646fed1c63/users/6cccd550e2294dcf82bed27d8415f892/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:41.140980 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50126d3-7015-4e77-a0b7-9b8c3e530578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82004674fb2b4ea49a63ee646fed1c63, user_id=6cccd550e2294dcf82bed27d8415f892, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:41.143582 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50126d3-7015-4e77-a0b7-9b8c3e530578 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:41.158836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1405/2810] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:41 2022] PUT /identity/v3/projects/82004674fb2b4ea49a63ee646fed1c63/users/6cccd550e2294dcf82bed27d8415f892/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 12:18:41.169369 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed141-6407-452c-8f56-e321059535a7 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:41.169662 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed141-6407-452c-8f56-e321059535a7 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:41.169947 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed141-6407-452c-8f56-e321059535a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:41.197298 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-34eed141-6407-452c-8f56-e321059535a7 None None] MFA Rules not processed for user `6cccd550e2294dcf82bed27d8415f892`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:41.198498 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-34eed141-6407-452c-8f56-e321059535a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:41.268901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1406/2811] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:18:41.281682 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50126d3-7015-4e77-a0b7-9b8c3e530578 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:41.283375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-e50126d3-7015-4e77-a0b7-9b8c3e530578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:41.368833 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50126d3-7015-4e77-a0b7-9b8c3e530578 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:41.372573 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d47778-3300-492d-a648-4c6c8eb7063e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767fe573dff349918c26995c206f2155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:41.373236 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d47778-3300-492d-a648-4c6c8eb7063e service glance] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:41.373517 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d47778-3300-492d-a648-4c6c8eb7063e service glance] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:41.373806 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d47778-3300-492d-a648-4c6c8eb7063e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:41.382322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d47778-3300-492d-a648-4c6c8eb7063e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:41.383748 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d47778-3300-492d-a648-4c6c8eb7063e service glance] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:41.392307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1406/2812] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:49.319443 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eed141-6407-452c-8f56-e321059535a7 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:49.320894 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-34eed141-6407-452c-8f56-e321059535a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:49.385469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eed141-6407-452c-8f56-e321059535a7 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:49.390004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:49.390869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:49.391153 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:49.391432 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] PATH_INFO: `/v3/users/6920b81028b0426786118de630012c60` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:49.392670 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6920b81028b0426786118de630012c60)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:49.394601 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:49.440462 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6920b81028b0426786118de630012c60'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:49.441146 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6920b81028b0426786118de630012c60'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:49.448787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6920b81028b0426786118de630012c60'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:49.456414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6920b81028b0426786118de630012c60'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:49.457035 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6920b81028b0426786118de630012c60'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:49.473842 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1407/2813] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:18:49 2022] DELETE /identity/v3/users/6920b81028b0426786118de630012c60 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:49.478492 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec44ae-7bd5-48cd-9c11-5cce8465d020 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:49.478969 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec44ae-7bd5-48cd-9c11-5cce8465d020 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:49.479089 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec44ae-7bd5-48cd-9c11-5cce8465d020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:49.497579 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-a3ec44ae-7bd5-48cd-9c11-5cce8465d020 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:49.498868 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a3ec44ae-7bd5-48cd-9c11-5cce8465d020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:49.557086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1407/2814] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:49.567201 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:49.568680 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:49.646227 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61066903-6f55-4ef5-94b0-18973d69e924 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:49.650504 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ce44-fddd-4ee0-bef4-82e6b222c725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:49.651147 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ce44-fddd-4ee0-bef4-82e6b222c725 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:49.651429 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ce44-fddd-4ee0-bef4-82e6b222c725 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:49.651705 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ce44-fddd-4ee0-bef4-82e6b222c725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:49.660565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21ce44-fddd-4ee0-bef4-82e6b222c725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:49.661982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21ce44-fddd-4ee0-bef4-82e6b222c725 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:49.671206 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1408/2815] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:18:49.943158 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec44ae-7bd5-48cd-9c11-5cce8465d020 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:49.944629 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a3ec44ae-7bd5-48cd-9c11-5cce8465d020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:49.961525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec44ae-7bd5-48cd-9c11-5cce8465d020 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:49.966295 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:49.967159 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:49.967459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:49.967739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] PATH_INFO: `/v3/projects/5b6b99f9edb3412893af3df914662e54` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:49.968962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6b99f9edb3412893af3df914662e54)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:49.970954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:50.019464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6b99f9edb3412893af3df914662e54', 'request_id': 'req-2a067218-4a06-44b8-9f07-07d39f0d6af7'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:50.026542 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6b99f9edb3412893af3df914662e54', 'request_id': 'req-2a067218-4a06-44b8-9f07-07d39f0d6af7'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:50.032890 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6b99f9edb3412893af3df914662e54', 'request_id': 'req-2a067218-4a06-44b8-9f07-07d39f0d6af7'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:50.042975 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] The token cache is being invalidate because project 5b6b99f9edb3412893af3df914662e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:18:50.043361 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:50.043996 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-2a067218-4a06-44b8-9f07-07d39f0d6af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:18:50.045559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1408/2816] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:18:49 2022] DELETE /identity/v3/projects/5b6b99f9edb3412893af3df914662e54 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:50.051792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e81319-bfcf-4714-9d4f-8fd9dc415824 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:50.052079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e81319-bfcf-4714-9d4f-8fd9dc415824 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:50.052388 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e81319-bfcf-4714-9d4f-8fd9dc415824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:50.099283 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-b6e81319-bfcf-4714-9d4f-8fd9dc415824 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:50.100675 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b6e81319-bfcf-4714-9d4f-8fd9dc415824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:50.158787 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1409/2817] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:50.167171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efabe-addf-4378-9822-9193451bfd29 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:50.167458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efabe-addf-4378-9822-9193451bfd29 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:50.167739 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efabe-addf-4378-9822-9193451bfd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:50.186580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-f86efabe-addf-4378-9822-9193451bfd29 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:50.187779 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-f86efabe-addf-4378-9822-9193451bfd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:50.195892 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1409/2818] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:50.199893 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e81319-bfcf-4714-9d4f-8fd9dc415824 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:50.211437 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e81319-bfcf-4714-9d4f-8fd9dc415824 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:50.216309 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c4a85-a0c3-4df6-826b-f3efe1f1728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:50.217231 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4a85-a0c3-4df6-826b-f3efe1f1728a admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:50.217511 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4a85-a0c3-4df6-826b-f3efe1f1728a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:50.217781 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4a85-a0c3-4df6-826b-f3efe1f1728a admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:50.218512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c4a85-a0c3-4df6-826b-f3efe1f1728a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:18:50.218820 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c4a85-a0c3-4df6-826b-f3efe1f1728a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:50.220440 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c4a85-a0c3-4df6-826b-f3efe1f1728a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:50.236149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1410/2819] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:18:50.237372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86efabe-addf-4378-9822-9193451bfd29 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:50.247437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86efabe-addf-4378-9822-9193451bfd29 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:50.252138 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe4462-c70b-4a18-b01f-7a6f76e254e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:50.252814 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe4462-c70b-4a18-b01f-7a6f76e254e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:50.253098 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe4462-c70b-4a18-b01f-7a6f76e254e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:50.253375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe4462-c70b-4a18-b01f-7a6f76e254e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:50.254061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe4462-c70b-4a18-b01f-7a6f76e254e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:50.255945 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe4462-c70b-4a18-b01f-7a6f76e254e3 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:50.282090 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1410/2820] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:18:50 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:18:50.286237 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c4a85-a0c3-4df6-826b-f3efe1f1728a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:50.297413 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c4a85-a0c3-4df6-826b-f3efe1f1728a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:50.364861 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e21ea3-56da-48b6-959f-73ab2d13c8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:50.366738 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e21ea3-56da-48b6-959f-73ab2d13c8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:50.367785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e21ea3-56da-48b6-959f-73ab2d13c8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:50.368233 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e21ea3-56da-48b6-959f-73ab2d13c8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:50.369257 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e21ea3-56da-48b6-959f-73ab2d13c8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:50.371864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e21ea3-56da-48b6-959f-73ab2d13c8f6 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:50.393822 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1411/2821] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:18:50 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:18:50.397209 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe4462-c70b-4a18-b01f-7a6f76e254e3 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:50.407734 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe4462-c70b-4a18-b01f-7a6f76e254e3 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:50.412691 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ea197-2ecf-49a7-99c8-eed2cea7572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:50.413364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ea197-2ecf-49a7-99c8-eed2cea7572b admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:50.413688 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ea197-2ecf-49a7-99c8-eed2cea7572b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:50.414458 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ea197-2ecf-49a7-99c8-eed2cea7572b admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:50.415217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ea197-2ecf-49a7-99c8-eed2cea7572b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:50.416840 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ea197-2ecf-49a7-99c8-eed2cea7572b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:50.427516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1411/2822] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:50.432421 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e21ea3-56da-48b6-959f-73ab2d13c8f6 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:50.442324 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e21ea3-56da-48b6-959f-73ab2d13c8f6 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:50.447107 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770dc46-a43c-49d4-a8bf-8dbbec355383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:50.447758 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770dc46-a43c-49d4-a8bf-8dbbec355383 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:50.448044 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770dc46-a43c-49d4-a8bf-8dbbec355383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:50.448386 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770dc46-a43c-49d4-a8bf-8dbbec355383 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:50.449457 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770dc46-a43c-49d4-a8bf-8dbbec355383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:50.451628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770dc46-a43c-49d4-a8bf-8dbbec355383 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:50.463046 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1412/2823] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:18:50.467215 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ea197-2ecf-49a7-99c8-eed2cea7572b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:50.477592 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ea197-2ecf-49a7-99c8-eed2cea7572b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:50.482149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a8f2c-2c38-4bef-a3b3-4d0fbeb8f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:50.483011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a8f2c-2c38-4bef-a3b3-4d0fbeb8f437 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:50.483292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a8f2c-2c38-4bef-a3b3-4d0fbeb8f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:50.483567 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a8f2c-2c38-4bef-a3b3-4d0fbeb8f437 admin admin] PATH_INFO: `/v3/projects/cc86c212437c44bcb381d27e28005a8a/users/a8e8d27902d84753ad93bf5202d936b0/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:50.498030 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a8f2c-2c38-4bef-a3b3-4d0fbeb8f437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc86c212437c44bcb381d27e28005a8a, user_id=a8e8d27902d84753ad93bf5202d936b0, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:50.500750 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a8f2c-2c38-4bef-a3b3-4d0fbeb8f437 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:50.513364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1412/2824] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:18:50 2022] PUT /identity/v3/projects/cc86c212437c44bcb381d27e28005a8a/users/a8e8d27902d84753ad93bf5202d936b0/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:18:50.525562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a40ec-ecda-4068-9ecf-7ee464227828 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:50.525859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a40ec-ecda-4068-9ecf-7ee464227828 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:50.526140 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a40ec-ecda-4068-9ecf-7ee464227828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:50.553779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-c06a40ec-ecda-4068-9ecf-7ee464227828 None None] MFA Rules not processed for user `a8e8d27902d84753ad93bf5202d936b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:18:50.555085 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-c06a40ec-ecda-4068-9ecf-7ee464227828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:50.618327 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1413/2825] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:18:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:18:50.630549 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a8f2c-2c38-4bef-a3b3-4d0fbeb8f437 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:18:50.632282 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-198a8f2c-2c38-4bef-a3b3-4d0fbeb8f437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:18:50.690424 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a8f2c-2c38-4bef-a3b3-4d0fbeb8f437 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:18:50.694410 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92a682-7c07-4603-a1d6-f49ea673a129 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767fe573dff349918c26995c206f2155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:18:50.695782 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92a682-7c07-4603-a1d6-f49ea673a129 service glance] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:18:50.696079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92a682-7c07-4603-a1d6-f49ea673a129 service glance] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:18:50.696393 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92a682-7c07-4603-a1d6-f49ea673a129 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:18:50.705098 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92a682-7c07-4603-a1d6-f49ea673a129 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:18:50.706628 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92a682-7c07-4603-a1d6-f49ea673a129 service glance] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:18:50.716478 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1413/2826] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:18:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:19:06.273220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d2e13-acec-4d7a-a750-0dd4a71eea08 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:06.273655 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d2e13-acec-4d7a-a750-0dd4a71eea08 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:06.273785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d2e13-acec-4d7a-a750-0dd4a71eea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:06.291918 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-001d2e13-acec-4d7a-a750-0dd4a71eea08 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:06.293159 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-001d2e13-acec-4d7a-a750-0dd4a71eea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:06.348691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1414/2827] 10.222.0.58 () {58 vars in 967 bytes} [Tue May 17 12:19:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:19:06.361460 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92a682-7c07-4603-a1d6-f49ea673a129 service glance] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:06.362876 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-af92a682-7c07-4603-a1d6-f49ea673a129 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:06.430251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92a682-7c07-4603-a1d6-f49ea673a129 service glance] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:06.435149 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2ec73-ab93-44ec-abb0-0bc40ee3870d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:06.435785 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2ec73-ab93-44ec-abb0-0bc40ee3870d service swift] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:06.436061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2ec73-ab93-44ec-abb0-0bc40ee3870d service swift] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:06.436372 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2ec73-ab93-44ec-abb0-0bc40ee3870d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:06.444292 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2ec73-ab93-44ec-abb0-0bc40ee3870d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:06.445810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2ec73-ab93-44ec-abb0-0bc40ee3870d service swift] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:06.454300 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1414/2828] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:19:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 12:19:12.978763 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d2e13-acec-4d7a-a750-0dd4a71eea08 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:12.980229 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-001d2e13-acec-4d7a-a750-0dd4a71eea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:13.055640 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d2e13-acec-4d7a-a750-0dd4a71eea08 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:13.060164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:13.061074 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:13.062691 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:13.062982 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] PATH_INFO: `/v3/users/e125d4ed850d49789402a28e4cbb58e1` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:13.064240 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e125d4ed850d49789402a28e4cbb58e1)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:13.066165 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:13.109779 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e125d4ed850d49789402a28e4cbb58e1'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.110433 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e125d4ed850d49789402a28e4cbb58e1'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.117152 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e125d4ed850d49789402a28e4cbb58e1'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.125365 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e125d4ed850d49789402a28e4cbb58e1'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.125995 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e125d4ed850d49789402a28e4cbb58e1'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.148864 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1415/2829] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:19:12 2022] DELETE /identity/v3/users/e125d4ed850d49789402a28e4cbb58e1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:13.308830 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2ec73-ab93-44ec-abb0-0bc40ee3870d service swift] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:13.320086 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2ec73-ab93-44ec-abb0-0bc40ee3870d service swift] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:13.383100 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:13.383953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:13.384259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:13.384534 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] PATH_INFO: `/v3/projects/2073530c2a5b4ad4a6543cdfa209c9f0` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:13.385709 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2073530c2a5b4ad4a6543cdfa209c9f0)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:13.388166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:13.437060 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2073530c2a5b4ad4a6543cdfa209c9f0', 'request_id': 'req-49520078-9529-407a-b868-c19432cc9f16'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.445698 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2073530c2a5b4ad4a6543cdfa209c9f0', 'request_id': 'req-49520078-9529-407a-b868-c19432cc9f16'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.452836 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2073530c2a5b4ad4a6543cdfa209c9f0', 'request_id': 'req-49520078-9529-407a-b868-c19432cc9f16'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.463457 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] The token cache is being invalidate because project 2073530c2a5b4ad4a6543cdfa209c9f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:19:13.463740 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.464482 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.466073 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1415/2830] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:19:13 2022] DELETE /identity/v3/projects/2073530c2a5b4ad4a6543cdfa209c9f0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:13.470932 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:13.472493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:13.486546 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d1459-4540-4fce-aa10-778d85aff998 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:13.543646 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:13.544544 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:13.544826 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:13.545099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] PATH_INFO: `/v3/users/0478494287aa45f9b03dcd35ff57e2ec` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:13.546308 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0478494287aa45f9b03dcd35ff57e2ec)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:13.548268 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:13.593832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0478494287aa45f9b03dcd35ff57e2ec'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.594486 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0478494287aa45f9b03dcd35ff57e2ec'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.601131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0478494287aa45f9b03dcd35ff57e2ec'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.607834 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0478494287aa45f9b03dcd35ff57e2ec'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.608473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0478494287aa45f9b03dcd35ff57e2ec'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.625328 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1416/2831] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:19:13 2022] DELETE /identity/v3/users/0478494287aa45f9b03dcd35ff57e2ec => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:13.794812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:13.796306 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:13.810699 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49520078-9529-407a-b868-c19432cc9f16 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:13.868763 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:13.869623 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:13.869904 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:13.870179 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] PATH_INFO: `/v3/projects/de777c06ba814ee5975856dd3f036cd3` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:13.871426 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de777c06ba814ee5975856dd3f036cd3)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:13.873548 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:13.919989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de777c06ba814ee5975856dd3f036cd3', 'request_id': 'req-9c570985-a251-458f-9b83-a4df91fbea23'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.927593 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de777c06ba814ee5975856dd3f036cd3', 'request_id': 'req-9c570985-a251-458f-9b83-a4df91fbea23'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.933779 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de777c06ba814ee5975856dd3f036cd3', 'request_id': 'req-9c570985-a251-458f-9b83-a4df91fbea23'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.944414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] The token cache is being invalidate because project de777c06ba814ee5975856dd3f036cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:19:13.944702 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.945341 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-9c570985-a251-458f-9b83-a4df91fbea23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:13.946866 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1416/2832] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:19:13 2022] DELETE /identity/v3/projects/de777c06ba814ee5975856dd3f036cd3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:33.037756 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:33.039232 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:33.054856 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042c908-4191-4550-9e68-ba2c1079810b admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:33.111668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:33.112571 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:33.112853 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:33.113125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] PATH_INFO: `/v3/users/6cccd550e2294dcf82bed27d8415f892` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:33.114296 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cccd550e2294dcf82bed27d8415f892)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:33.116204 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:33.158972 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cccd550e2294dcf82bed27d8415f892'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:33.159634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cccd550e2294dcf82bed27d8415f892'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:33.166125 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cccd550e2294dcf82bed27d8415f892'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:33.173600 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cccd550e2294dcf82bed27d8415f892'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:33.174235 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cccd550e2294dcf82bed27d8415f892'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:33.191277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1417/2833] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:19:33 2022] DELETE /identity/v3/users/6cccd550e2294dcf82bed27d8415f892 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:33.195736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf0bb-de95-4e15-a97b-8c616fd4a76f None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:33.196242 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf0bb-de95-4e15-a97b-8c616fd4a76f None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:33.196364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf0bb-de95-4e15-a97b-8c616fd4a76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:33.213657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-83daf0bb-de95-4e15-a97b-8c616fd4a76f None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:33.214828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-83daf0bb-de95-4e15-a97b-8c616fd4a76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:33.271375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1417/2834] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:19:33.280951 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:33.283087 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:33.344247 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9635b-9828-408e-8131-afdd6eab0732 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:33.348516 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dca659-7d68-4362-9337-b669e0c5d45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:33.349207 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dca659-7d68-4362-9337-b669e0c5d45b service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:33.349501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dca659-7d68-4362-9337-b669e0c5d45b service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:33.349781 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dca659-7d68-4362-9337-b669e0c5d45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:33.360891 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dca659-7d68-4362-9337-b669e0c5d45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:33.362345 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dca659-7d68-4362-9337-b669e0c5d45b service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:33.372656 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1418/2835] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:19:33.669543 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daf0bb-de95-4e15-a97b-8c616fd4a76f None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:33.671601 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-83daf0bb-de95-4e15-a97b-8c616fd4a76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:33.685693 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daf0bb-de95-4e15-a97b-8c616fd4a76f None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:33.692441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:33.694085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:33.694397 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:33.694649 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] PATH_INFO: `/v3/projects/82004674fb2b4ea49a63ee646fed1c63` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:33.696493 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82004674fb2b4ea49a63ee646fed1c63)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:33.698962 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:33.750825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82004674fb2b4ea49a63ee646fed1c63', 'request_id': 'req-a8ea8345-b0de-4db2-8659-b5946057ea45'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:33.758356 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82004674fb2b4ea49a63ee646fed1c63', 'request_id': 'req-a8ea8345-b0de-4db2-8659-b5946057ea45'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:33.765972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82004674fb2b4ea49a63ee646fed1c63', 'request_id': 'req-a8ea8345-b0de-4db2-8659-b5946057ea45'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:33.776331 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] The token cache is being invalidate because project 82004674fb2b4ea49a63ee646fed1c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:19:33.776555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:33.777238 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a8ea8345-b0de-4db2-8659-b5946057ea45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:33.778794 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1418/2836] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:19:33 2022] DELETE /identity/v3/projects/82004674fb2b4ea49a63ee646fed1c63 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:33.784512 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578f4b0-149f-4613-9c35-b9037d30080a None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:33.784812 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578f4b0-149f-4613-9c35-b9037d30080a None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:33.785092 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578f4b0-149f-4613-9c35-b9037d30080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:33.802276 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-2578f4b0-149f-4613-9c35-b9037d30080a None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:33.803461 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-2578f4b0-149f-4613-9c35-b9037d30080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:33.860539 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1419/2837] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:19:33.868067 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e995a19-9e98-49c8-b375-ddb052ef1322 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:33.868386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e995a19-9e98-49c8-b375-ddb052ef1322 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:33.868663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e995a19-9e98-49c8-b375-ddb052ef1322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:33.886914 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-2e995a19-9e98-49c8-b375-ddb052ef1322 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:33.888092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2e995a19-9e98-49c8-b375-ddb052ef1322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:33.896993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1419/2838] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:19:33.901089 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578f4b0-149f-4613-9c35-b9037d30080a None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:33.910411 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578f4b0-149f-4613-9c35-b9037d30080a None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:33.914842 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c58b-d2b9-4d83-824a-b5feea4b66fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:33.915482 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c58b-d2b9-4d83-824a-b5feea4b66fb admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:33.915761 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c58b-d2b9-4d83-824a-b5feea4b66fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:33.916033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c58b-d2b9-4d83-824a-b5feea4b66fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:33.916792 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5c58b-d2b9-4d83-824a-b5feea4b66fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:19:33.917103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5c58b-d2b9-4d83-824a-b5feea4b66fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:33.918681 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5c58b-d2b9-4d83-824a-b5feea4b66fb admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:33.929874 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1420/2839] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 12:19:33.933963 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e995a19-9e98-49c8-b375-ddb052ef1322 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:33.943756 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e995a19-9e98-49c8-b375-ddb052ef1322 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:33.948450 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327fa46-4a63-4db2-8e6e-5e8376608895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:33.949094 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327fa46-4a63-4db2-8e6e-5e8376608895 admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:33.949376 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327fa46-4a63-4db2-8e6e-5e8376608895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:33.949656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327fa46-4a63-4db2-8e6e-5e8376608895 admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:33.950599 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327fa46-4a63-4db2-8e6e-5e8376608895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:33.953127 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327fa46-4a63-4db2-8e6e-5e8376608895 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:33.977675 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1420/2840] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:19:33 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 12:19:33.981614 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c58b-d2b9-4d83-824a-b5feea4b66fb admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:33.991391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c58b-d2b9-4d83-824a-b5feea4b66fb admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:34.044764 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aac9ac-3bd4-411b-b171-78113958f47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:34.045397 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac9ac-3bd4-411b-b171-78113958f47e admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:34.045636 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac9ac-3bd4-411b-b171-78113958f47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:34.045916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac9ac-3bd4-411b-b171-78113958f47e admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:34.046665 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aac9ac-3bd4-411b-b171-78113958f47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:34.048804 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aac9ac-3bd4-411b-b171-78113958f47e admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:34.067727 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1421/2841] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:19:33 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:19:34.071825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327fa46-4a63-4db2-8e6e-5e8376608895 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:34.082859 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327fa46-4a63-4db2-8e6e-5e8376608895 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:34.087404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e3d09-777e-4555-b58b-004e25722e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:34.088056 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e3d09-777e-4555-b58b-004e25722e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:34.088375 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e3d09-777e-4555-b58b-004e25722e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:34.088656 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e3d09-777e-4555-b58b-004e25722e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:34.089379 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e3d09-777e-4555-b58b-004e25722e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:34.090971 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e3d09-777e-4555-b58b-004e25722e07 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:34.101059 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1421/2842] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:19:34.104927 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aac9ac-3bd4-411b-b171-78113958f47e admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:34.114427 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aac9ac-3bd4-411b-b171-78113958f47e admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:34.118866 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3661d9-1887-424a-ae71-89e47b8fa8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:34.119503 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3661d9-1887-424a-ae71-89e47b8fa8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:34.119783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3661d9-1887-424a-ae71-89e47b8fa8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:34.120055 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3661d9-1887-424a-ae71-89e47b8fa8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:34.120830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3661d9-1887-424a-ae71-89e47b8fa8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:34.122432 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3661d9-1887-424a-ae71-89e47b8fa8f8 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:34.132677 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1422/2843] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:19:34.136757 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e3d09-777e-4555-b58b-004e25722e07 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:34.147571 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e3d09-777e-4555-b58b-004e25722e07 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:34.152153 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141d2f5-af2e-46e2-8b18-e7ba19f66d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:34.153053 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d2f5-af2e-46e2-8b18-e7ba19f66d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:34.153342 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d2f5-af2e-46e2-8b18-e7ba19f66d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:34.153622 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d2f5-af2e-46e2-8b18-e7ba19f66d7b admin admin] PATH_INFO: `/v3/projects/fe68b341b9a14a9d94e87cd6c5466f6a/users/34b2cf3184a045ab9e8870b3b0826620/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:34.168143 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141d2f5-af2e-46e2-8b18-e7ba19f66d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe68b341b9a14a9d94e87cd6c5466f6a, user_id=34b2cf3184a045ab9e8870b3b0826620, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:34.170810 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141d2f5-af2e-46e2-8b18-e7ba19f66d7b admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:34.183872 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1422/2844] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:19:34 2022] PUT /identity/v3/projects/fe68b341b9a14a9d94e87cd6c5466f6a/users/34b2cf3184a045ab9e8870b3b0826620/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:34.194565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f4da-6af7-42b0-806a-8a9436c9753e None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:34.194860 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f4da-6af7-42b0-806a-8a9436c9753e None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:34.195142 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f4da-6af7-42b0-806a-8a9436c9753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:34.222830 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-df26f4da-6af7-42b0-806a-8a9436c9753e None None] MFA Rules not processed for user `34b2cf3184a045ab9e8870b3b0826620`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:34.224071 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-df26f4da-6af7-42b0-806a-8a9436c9753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:34.286036 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1423/2845] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:19:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:19:34.297176 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141d2f5-af2e-46e2-8b18-e7ba19f66d7b admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:34.298775 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-d141d2f5-af2e-46e2-8b18-e7ba19f66d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:34.374559 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141d2f5-af2e-46e2-8b18-e7ba19f66d7b admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:34.378302 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca23a4-c5bd-45d6-a3dc-af01fe592407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:34.378941 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca23a4-c5bd-45d6-a3dc-af01fe592407 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:34.379225 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca23a4-c5bd-45d6-a3dc-af01fe592407 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:34.379501 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca23a4-c5bd-45d6-a3dc-af01fe592407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:34.388042 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca23a4-c5bd-45d6-a3dc-af01fe592407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:34.389552 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca23a4-c5bd-45d6-a3dc-af01fe592407 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:34.398650 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1423/2846] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:19:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:19:35.726647 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268e54-c197-4f77-b558-d2e70631ebd9 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:35.727170 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268e54-c197-4f77-b558-d2e70631ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:35.727270 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50268e54-c197-4f77-b558-d2e70631ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:35.746588 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-50268e54-c197-4f77-b558-d2e70631ebd9 None None] MFA Rules not processed for user `34b2cf3184a045ab9e8870b3b0826620`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:35.747816 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-50268e54-c197-4f77-b558-d2e70631ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:35.755584 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1424/2847] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:19:39.157796 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca23a4-c5bd-45d6-a3dc-af01fe592407 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:39.159230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-94ca23a4-c5bd-45d6-a3dc-af01fe592407 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:39.248934 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca23a4-c5bd-45d6-a3dc-af01fe592407 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:39.254580 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee3a3-bb55-4581-ab91-4336ca0631a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5222a62941948229324ec8c073caf86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:39.255219 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee3a3-bb55-4581-ab91-4336ca0631a9 service placement] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:39.255496 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee3a3-bb55-4581-ab91-4336ca0631a9 service placement] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:39.255769 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee3a3-bb55-4581-ab91-4336ca0631a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:39.257539 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-15bee3a3-bb55-4581-ab91-4336ca0631a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:39.268916 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee3a3-bb55-4581-ab91-4336ca0631a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:39.270343 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee3a3-bb55-4581-ab91-4336ca0631a9 service placement] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:39.279862 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1424/2848] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:19:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:19:44.892098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50268e54-c197-4f77-b558-d2e70631ebd9 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:44.893521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-50268e54-c197-4f77-b558-d2e70631ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:44.958387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50268e54-c197-4f77-b558-d2e70631ebd9 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:44.962911 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:44.963800 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:44.964079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:44.964380 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] PATH_INFO: `/v3/users/a8e8d27902d84753ad93bf5202d936b0` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:44.965564 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e8d27902d84753ad93bf5202d936b0)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:44.967467 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:45.013209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e8d27902d84753ad93bf5202d936b0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:45.013929 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e8d27902d84753ad93bf5202d936b0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:45.020881 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e8d27902d84753ad93bf5202d936b0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:45.028244 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e8d27902d84753ad93bf5202d936b0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:45.029122 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e8d27902d84753ad93bf5202d936b0'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:45.047015 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1425/2849] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:19:44 2022] DELETE /identity/v3/users/a8e8d27902d84753ad93bf5202d936b0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:45.051809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12fba-249c-4a99-9dcb-ca875b227357 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:45.052365 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12fba-249c-4a99-9dcb-ca875b227357 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:45.052495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e12fba-249c-4a99-9dcb-ca875b227357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:45.069162 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-b8e12fba-249c-4a99-9dcb-ca875b227357 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:45.070352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b8e12fba-249c-4a99-9dcb-ca875b227357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:45.131400 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1425/2850] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:19:45.141686 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:45.143099 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:45.198414 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999bd61-4382-4ef1-8c7e-66df05a0aab4 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:45.202258 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0893da-5e09-4dbb-8c95-2fa9a7cbc64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:45.203446 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0893da-5e09-4dbb-8c95-2fa9a7cbc64b service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:45.203708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0893da-5e09-4dbb-8c95-2fa9a7cbc64b service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:45.203994 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0893da-5e09-4dbb-8c95-2fa9a7cbc64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:45.212732 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0893da-5e09-4dbb-8c95-2fa9a7cbc64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:45.214200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0893da-5e09-4dbb-8c95-2fa9a7cbc64b service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:45.224228 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1426/2851] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:19:45.485062 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12fba-249c-4a99-9dcb-ca875b227357 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:45.486901 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b8e12fba-249c-4a99-9dcb-ca875b227357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:45.499659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e12fba-249c-4a99-9dcb-ca875b227357 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:45.505651 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:45.506507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:45.506912 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:45.507194 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] PATH_INFO: `/v3/projects/cc86c212437c44bcb381d27e28005a8a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:45.508427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc86c212437c44bcb381d27e28005a8a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:45.510339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:45.565983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc86c212437c44bcb381d27e28005a8a', 'request_id': 'req-a38ffd6d-12a4-4181-884d-b8557df54fba'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:45.574727 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc86c212437c44bcb381d27e28005a8a', 'request_id': 'req-a38ffd6d-12a4-4181-884d-b8557df54fba'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:45.583909 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc86c212437c44bcb381d27e28005a8a', 'request_id': 'req-a38ffd6d-12a4-4181-884d-b8557df54fba'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:45.595516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] The token cache is being invalidate because project cc86c212437c44bcb381d27e28005a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:19:45.595924 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:45.596663 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:45.608011 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1426/2852] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:19:45 2022] DELETE /identity/v3/projects/cc86c212437c44bcb381d27e28005a8a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:52.924079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92178146-a356-4414-bcf5-2dda6c31cbbb None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:52.924565 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92178146-a356-4414-bcf5-2dda6c31cbbb None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:52.924682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92178146-a356-4414-bcf5-2dda6c31cbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:52.941669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-92178146-a356-4414-bcf5-2dda6c31cbbb None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:52.942882 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-92178146-a356-4414-bcf5-2dda6c31cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:52.997079 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1427/2853] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:19:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:19:53.018213 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:53.019568 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:53.086857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ffd6d-12a4-4181-884d-b8557df54fba admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:53.091687 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b71037-4cb6-4593-983f-ee8863286f1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:53.092352 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71037-4cb6-4593-983f-ee8863286f1b service swift] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:53.092633 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71037-4cb6-4593-983f-ee8863286f1b service swift] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:53.092903 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71037-4cb6-4593-983f-ee8863286f1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:53.101293 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b71037-4cb6-4593-983f-ee8863286f1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:53.102853 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b71037-4cb6-4593-983f-ee8863286f1b service swift] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:53.110815 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1427/2854] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:19:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 12:19:53.596869 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59a20-be56-4975-89db-38a07f61c0e8 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:53.597167 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59a20-be56-4975-89db-38a07f61c0e8 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:53.597450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d59a20-be56-4975-89db-38a07f61c0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:53.616715 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-b3d59a20-be56-4975-89db-38a07f61c0e8 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:53.617904 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-b3d59a20-be56-4975-89db-38a07f61c0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:53.625859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1428/2855] 10.222.0.58 () {58 vars in 967 bytes} [Tue May 17 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:19:53.638079 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b71037-4cb6-4593-983f-ee8863286f1b service swift] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:53.649123 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b71037-4cb6-4593-983f-ee8863286f1b service swift] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:53.654107 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d49be6-4fa3-4f72-8cea-058a9f9df49b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:53.654736 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49be6-4fa3-4f72-8cea-058a9f9df49b service swift] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:53.655022 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49be6-4fa3-4f72-8cea-058a9f9df49b service swift] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:53.655303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d49be6-4fa3-4f72-8cea-058a9f9df49b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:53.664390 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d49be6-4fa3-4f72-8cea-058a9f9df49b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:53.665961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d49be6-4fa3-4f72-8cea-058a9f9df49b service swift] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:53.674905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1428/2856] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:19:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 12:19:53.859958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33296b-f752-4c28-8afa-57b303279037 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:53.860267 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33296b-f752-4c28-8afa-57b303279037 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:53.860547 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33296b-f752-4c28-8afa-57b303279037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:53.877545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-ca33296b-f752-4c28-8afa-57b303279037 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:53.878708 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ca33296b-f752-4c28-8afa-57b303279037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:53.885658 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1429/2857] 10.222.0.58 () {58 vars in 1009 bytes} [Tue May 17 12:19:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:19:53.897364 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d49be6-4fa3-4f72-8cea-058a9f9df49b service swift] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:53.908322 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d49be6-4fa3-4f72-8cea-058a9f9df49b service swift] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:53.913296 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e5b6c-637d-46c0-904e-f636bba909ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:53.913917 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e5b6c-637d-46c0-904e-f636bba909ae service swift] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:53.914196 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e5b6c-637d-46c0-904e-f636bba909ae service swift] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:53.914468 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e5b6c-637d-46c0-904e-f636bba909ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:53.922761 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e5b6c-637d-46c0-904e-f636bba909ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:53.924347 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e5b6c-637d-46c0-904e-f636bba909ae service swift] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:53.932006 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1429/2858] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:19:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 12:19:54.236637 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21b053-7c67-44e3-ac04-a3d4c8ca3a35 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:54.237129 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21b053-7c67-44e3-ac04-a3d4c8ca3a35 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:54.237253 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21b053-7c67-44e3-ac04-a3d4c8ca3a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:54.255277 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-5c21b053-7c67-44e3-ac04-a3d4c8ca3a35 None None] MFA Rules not processed for user `1fbb465d777c4f02b7777ad154d09c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:54.256508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5c21b053-7c67-44e3-ac04-a3d4c8ca3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:54.263557 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1430/2859] 10.222.0.58 () {58 vars in 967 bytes} [Tue May 17 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 12:19:54.275911 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e5b6c-637d-46c0-904e-f636bba909ae service swift] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:54.286556 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e5b6c-637d-46c0-904e-f636bba909ae service swift] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:54.291822 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d006b53-ea7a-4892-b449-5810f889c7dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5206e8bbb04042f4b00637518f297a97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:54.292514 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006b53-ea7a-4892-b449-5810f889c7dd service swift] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:54.292802 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006b53-ea7a-4892-b449-5810f889c7dd service swift] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:54.293085 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006b53-ea7a-4892-b449-5810f889c7dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:54.302217 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d006b53-ea7a-4892-b449-5810f889c7dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:54.304025 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d006b53-ea7a-4892-b449-5810f889c7dd service swift] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:54.314847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1430/2860] 10.222.0.58 () {60 vars in 1384 bytes} [Tue May 17 12:19:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 12:19:56.686473 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21b053-7c67-44e3-ac04-a3d4c8ca3a35 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:56.688517 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5c21b053-7c67-44e3-ac04-a3d4c8ca3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:56.752025 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21b053-7c67-44e3-ac04-a3d4c8ca3a35 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:56.756509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:56.757739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:56.757739 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:56.758104 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] PATH_INFO: `/v3/users/34b2cf3184a045ab9e8870b3b0826620` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:56.759136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b2cf3184a045ab9e8870b3b0826620)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:56.761090 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:56.807018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b2cf3184a045ab9e8870b3b0826620'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:56.807683 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b2cf3184a045ab9e8870b3b0826620'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:56.815162 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b2cf3184a045ab9e8870b3b0826620'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:56.822065 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b2cf3184a045ab9e8870b3b0826620'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:56.822718 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b2cf3184a045ab9e8870b3b0826620'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:56.839908 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1431/2861] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:19:56 2022] DELETE /identity/v3/users/34b2cf3184a045ab9e8870b3b0826620 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:56.844500 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0a20-e791-4e32-a1e1-298a89a147cd None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:56.844968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0a20-e791-4e32-a1e1-298a89a147cd None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:56.845105 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0a20-e791-4e32-a1e1-298a89a147cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:56.862014 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-fb9c0a20-e791-4e32-a1e1-298a89a147cd None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:56.863178 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-fb9c0a20-e791-4e32-a1e1-298a89a147cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:56.919927 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1431/2862] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:19:56.929540 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:56.931061 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:56.986723 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9228b-9d0b-423b-8109-c6827a24fb4a admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:56.990282 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f8f02-429a-41a0-aa21-28b052c2463a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:56.990972 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f8f02-429a-41a0-aa21-28b052c2463a service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:56.991236 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f8f02-429a-41a0-aa21-28b052c2463a service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:56.991509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f8f02-429a-41a0-aa21-28b052c2463a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.001208 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f8f02-429a-41a0-aa21-28b052c2463a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:57.002626 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f8f02-429a-41a0-aa21-28b052c2463a service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:57.011628 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1432/2863] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:19:57.176891 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0a20-e791-4e32-a1e1-298a89a147cd None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:57.178385 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-fb9c0a20-e791-4e32-a1e1-298a89a147cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:57.193772 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0a20-e791-4e32-a1e1-298a89a147cd None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:57.198826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:57.199683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:57.199982 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:57.200259 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] PATH_INFO: `/v3/projects/fe68b341b9a14a9d94e87cd6c5466f6a` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.201825 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe68b341b9a14a9d94e87cd6c5466f6a)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:57.203719 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:57.248144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'request_id': 'req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:57.255516 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'request_id': 'req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:57.261555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'request_id': 'req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:57.271402 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] The token cache is being invalidate because project fe68b341b9a14a9d94e87cd6c5466f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79871) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:19:57.271684 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:57.272339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-4c7ca825-20ac-4aba-8eb6-330c883ac8c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:19:57.273847 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1432/2864] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:19:57 2022] DELETE /identity/v3/projects/fe68b341b9a14a9d94e87cd6c5466f6a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:57.278884 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47666-391a-40bb-acac-903ac153bdb0 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:57.279175 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47666-391a-40bb-acac-903ac153bdb0 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:57.279455 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47666-391a-40bb-acac-903ac153bdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.297007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-a4f47666-391a-40bb-acac-903ac153bdb0 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:57.298181 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a4f47666-391a-40bb-acac-903ac153bdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:57.355425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1433/2865] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:19:57.363870 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671da9e7-7890-4ba9-8f88-7593af88094e None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:57.364160 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671da9e7-7890-4ba9-8f88-7593af88094e None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:57.364473 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671da9e7-7890-4ba9-8f88-7593af88094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.384032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-671da9e7-7890-4ba9-8f88-7593af88094e None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:57.385258 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-671da9e7-7890-4ba9-8f88-7593af88094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:57.393171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1433/2866] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:19:57.397372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f47666-391a-40bb-acac-903ac153bdb0 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:57.407469 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f47666-391a-40bb-acac-903ac153bdb0 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:57.412075 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdff95-d4bf-4a4a-ace9-0409c2dfe2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:57.412759 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdff95-d4bf-4a4a-ace9-0409c2dfe2bd admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:57.413046 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdff95-d4bf-4a4a-ace9-0409c2dfe2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:57.413325 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdff95-d4bf-4a4a-ace9-0409c2dfe2bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.414056 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdff95-d4bf-4a4a-ace9-0409c2dfe2bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 12:19:57.414368 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdff95-d4bf-4a4a-ace9-0409c2dfe2bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:57.415958 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdff95-d4bf-4a4a-ace9-0409c2dfe2bd admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:57.429271 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1434/2867] 10.222.0.58 () {58 vars in 1152 bytes} [Tue May 17 12:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 12:19:57.443643 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671da9e7-7890-4ba9-8f88-7593af88094e None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:57.453697 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671da9e7-7890-4ba9-8f88-7593af88094e None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:57.458509 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c94b9-f23f-4f13-9e84-37dee61ec5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:57.459166 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c94b9-f23f-4f13-9e84-37dee61ec5bc admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:57.459445 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c94b9-f23f-4f13-9e84-37dee61ec5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:57.459718 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c94b9-f23f-4f13-9e84-37dee61ec5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.460448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c94b9-f23f-4f13-9e84-37dee61ec5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:57.462348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c94b9-f23f-4f13-9e84-37dee61ec5bc admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:57.489374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1434/2868] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:19:57 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:19:57.493633 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdff95-d4bf-4a4a-ace9-0409c2dfe2bd admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:57.503374 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdff95-d4bf-4a4a-ace9-0409c2dfe2bd admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:57.560004 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806565f3-eba4-4d54-afd6-07e296ed59de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:57.560699 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806565f3-eba4-4d54-afd6-07e296ed59de admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:57.560980 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806565f3-eba4-4d54-afd6-07e296ed59de admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:57.561255 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806565f3-eba4-4d54-afd6-07e296ed59de admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.562027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806565f3-eba4-4d54-afd6-07e296ed59de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:57.564018 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806565f3-eba4-4d54-afd6-07e296ed59de admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:57.583311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1435/2869] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:19:57 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:19:57.587503 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c94b9-f23f-4f13-9e84-37dee61ec5bc admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:57.598013 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c94b9-f23f-4f13-9e84-37dee61ec5bc admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:57.603551 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb4d4a-9801-4d52-afa5-5e24879aa667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:57.604414 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb4d4a-9801-4d52-afa5-5e24879aa667 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:57.604732 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb4d4a-9801-4d52-afa5-5e24879aa667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:57.605032 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb4d4a-9801-4d52-afa5-5e24879aa667 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.605826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb4d4a-9801-4d52-afa5-5e24879aa667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:57.607374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb4d4a-9801-4d52-afa5-5e24879aa667 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:57.617760 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1435/2870] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:19:57.621646 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806565f3-eba4-4d54-afd6-07e296ed59de admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:57.632080 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806565f3-eba4-4d54-afd6-07e296ed59de admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:57.636689 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6714b-c917-484b-90dc-844660cadca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:57.637340 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6714b-c917-484b-90dc-844660cadca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:57.637623 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6714b-c917-484b-90dc-844660cadca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:57.637898 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6714b-c917-484b-90dc-844660cadca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.638669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6714b-c917-484b-90dc-844660cadca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:57.640969 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6714b-c917-484b-90dc-844660cadca3 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:57.650745 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1436/2871] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:19:57.654779 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb4d4a-9801-4d52-afa5-5e24879aa667 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:57.666427 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb4d4a-9801-4d52-afa5-5e24879aa667 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:57.671072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72727d-3b50-498d-8845-7711cfcfb051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:57.672109 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72727d-3b50-498d-8845-7711cfcfb051 admin admin] REQUEST_METHOD: `PUT` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:57.672495 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72727d-3b50-498d-8845-7711cfcfb051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:57.672771 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72727d-3b50-498d-8845-7711cfcfb051 admin admin] PATH_INFO: `/v3/projects/96b18ec30b804e1e9ac7467a441c919b/users/934f4b8dae3b410ebc6b8c03f47b15a7/roles/1ead91d8230c468cabd0637c833c42ac` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.687731 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72727d-3b50-498d-8845-7711cfcfb051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b18ec30b804e1e9ac7467a441c919b, user_id=934f4b8dae3b410ebc6b8c03f47b15a7, role_id=1ead91d8230c468cabd0637c833c42ac)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:57.690466 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72727d-3b50-498d-8845-7711cfcfb051 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:57.704303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1436/2872] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:19:57 2022] PUT /identity/v3/projects/96b18ec30b804e1e9ac7467a441c919b/users/934f4b8dae3b410ebc6b8c03f47b15a7/roles/1ead91d8230c468cabd0637c833c42ac => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:19:57.709294 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0a574-97be-4f12-9494-70046196e665 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:57.709785 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0a574-97be-4f12-9494-70046196e665 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:57.709905 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0a574-97be-4f12-9494-70046196e665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.727795 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-41a0a574-97be-4f12-9494-70046196e665 None None] MFA Rules not processed for user `f0ae019bc4584bc39f9f7fb0d0af90e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:19:57.730011 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-41a0a574-97be-4f12-9494-70046196e665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:57.787243 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1437/2873] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:19:57.797386 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72727d-3b50-498d-8845-7711cfcfb051 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:19:57.799205 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-2d72727d-3b50-498d-8845-7711cfcfb051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:19:57.854189 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72727d-3b50-498d-8845-7711cfcfb051 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:19:57.857993 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d3ad2-2603-413d-aafc-559184a3d727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:19:57.858575 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3ad2-2603-413d-aafc-559184a3d727 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:19:57.859533 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3ad2-2603-413d-aafc-559184a3d727 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:19:57.859899 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3ad2-2603-413d-aafc-559184a3d727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:19:57.868856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d3ad2-2603-413d-aafc-559184a3d727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:19:57.870274 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d3ad2-2603-413d-aafc-559184a3d727 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:19:57.880128 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1437/2874] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:20:01.719497 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc56c1-a967-45c4-b858-5ff257572b69 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:01.720013 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc56c1-a967-45c4-b858-5ff257572b69 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:01.720342 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc56c1-a967-45c4-b858-5ff257572b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:01.746287 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-bdcc56c1-a967-45c4-b858-5ff257572b69 None None] MFA Rules not processed for user `934f4b8dae3b410ebc6b8c03f47b15a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:20:01.747581 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-bdcc56c1-a967-45c4-b858-5ff257572b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:20:01.818007 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1438/2875] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:20:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:20:01.822570 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d3ad2-2603-413d-aafc-559184a3d727 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:20:01.832955 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d3ad2-2603-413d-aafc-559184a3d727 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:20:01.837507 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d137a61-d774-47a0-9c73-4f07eadbfa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:20:01.838175 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d137a61-d774-47a0-9c73-4f07eadbfa9c admin admin] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:01.838464 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d137a61-d774-47a0-9c73-4f07eadbfa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:01.838742 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d137a61-d774-47a0-9c73-4f07eadbfa9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:01.839452 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d137a61-d774-47a0-9c73-4f07eadbfa9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:20:01.841481 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d137a61-d774-47a0-9c73-4f07eadbfa9c admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:20:01.870459 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1438/2876] 10.222.0.58 () {60 vars in 1152 bytes} [Tue May 17 12:20:01 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:20:01.875783 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc56c1-a967-45c4-b858-5ff257572b69 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:20:01.886483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc56c1-a967-45c4-b858-5ff257572b69 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:20:01.954668 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e254f-e15b-4283-8261-743c6c70c72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:20:01.955536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e254f-e15b-4283-8261-743c6c70c72f admin admin] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:01.955905 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e254f-e15b-4283-8261-743c6c70c72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:01.956306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e254f-e15b-4283-8261-743c6c70c72f admin admin] PATH_INFO: `/v3/users` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:01.957252 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e254f-e15b-4283-8261-743c6c70c72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:20:01.959200 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e254f-e15b-4283-8261-743c6c70c72f admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:20:01.987468 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1439/2877] 10.222.0.58 () {60 vars in 1143 bytes} [Tue May 17 12:20:01 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 12:20:01.991374 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d137a61-d774-47a0-9c73-4f07eadbfa9c admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:20:02.002883 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d137a61-d774-47a0-9c73-4f07eadbfa9c admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:20:02.007801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235628f-700e-4967-9e36-e641465bf731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:20:02.008597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235628f-700e-4967-9e36-e641465bf731 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:02.008953 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235628f-700e-4967-9e36-e641465bf731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:02.009302 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235628f-700e-4967-9e36-e641465bf731 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:02.010117 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235628f-700e-4967-9e36-e641465bf731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:20:02.011821 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235628f-700e-4967-9e36-e641465bf731 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:20:02.024462 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1439/2878] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:20:02.028651 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e254f-e15b-4283-8261-743c6c70c72f admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:20:02.039855 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e254f-e15b-4283-8261-743c6c70c72f admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:20:02.044646 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc811-f1ad-4ed5-b3a2-4039a7f19e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:20:02.045545 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc811-f1ad-4ed5-b3a2-4039a7f19e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:02.045828 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc811-f1ad-4ed5-b3a2-4039a7f19e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:02.046108 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc811-f1ad-4ed5-b3a2-4039a7f19e71 admin admin] PATH_INFO: `/v3/projects/ce259642aa1048e59412b157eae009fa/users/8d914744ac8a4086830add2933d0582f/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:02.063408 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc811-f1ad-4ed5-b3a2-4039a7f19e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce259642aa1048e59412b157eae009fa, user_id=8d914744ac8a4086830add2933d0582f, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:20:02.066407 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc811-f1ad-4ed5-b3a2-4039a7f19e71 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:20:02.080561 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1440/2879] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:20:02 2022] PUT /identity/v3/projects/ce259642aa1048e59412b157eae009fa/users/8d914744ac8a4086830add2933d0582f/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:20:02.084812 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235628f-700e-4967-9e36-e641465bf731 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:20:02.095817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235628f-700e-4967-9e36-e641465bf731 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:20:02.152572 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bd696-0732-48a3-9a02-a39b4ce07826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:20:02.153251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd696-0732-48a3-9a02-a39b4ce07826 admin admin] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:02.153537 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd696-0732-48a3-9a02-a39b4ce07826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:02.153817 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd696-0732-48a3-9a02-a39b4ce07826 admin admin] PATH_INFO: `/v3/roles` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:02.154566 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bd696-0732-48a3-9a02-a39b4ce07826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:20:02.157226 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bd696-0732-48a3-9a02-a39b4ce07826 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:20:02.167809 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1440/2880] 10.222.0.58 () {58 vars in 1121 bytes} [Tue May 17 12:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 12:20:02.172506 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc811-f1ad-4ed5-b3a2-4039a7f19e71 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:20:02.183039 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc811-f1ad-4ed5-b3a2-4039a7f19e71 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:20:02.187897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd06c7-4477-4e25-9736-b88617b8d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:20:02.188752 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd06c7-4477-4e25-9736-b88617b8d3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:02.189034 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd06c7-4477-4e25-9736-b88617b8d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:02.189311 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd06c7-4477-4e25-9736-b88617b8d3d1 admin admin] PATH_INFO: `/v3/projects/ce259642aa1048e59412b157eae009fa/users/8d914744ac8a4086830add2933d0582f/roles/3db33dfd3d6544fd81933007633fc56a` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:02.191314 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd06c7-4477-4e25-9736-b88617b8d3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce259642aa1048e59412b157eae009fa, user_id=8d914744ac8a4086830add2933d0582f, role_id=3db33dfd3d6544fd81933007633fc56a)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:20:02.194028 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd06c7-4477-4e25-9736-b88617b8d3d1 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:20:02.205357 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1441/2881] 10.222.0.58 () {60 vars in 1482 bytes} [Tue May 17 12:20:02 2022] PUT /identity/v3/projects/ce259642aa1048e59412b157eae009fa/users/8d914744ac8a4086830add2933d0582f/roles/3db33dfd3d6544fd81933007633fc56a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:20:06.539920 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecaeb-7097-45a5-a9e7-a56036eb3ccc None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:06.540801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecaeb-7097-45a5-a9e7-a56036eb3ccc None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:06.541144 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecaeb-7097-45a5-a9e7-a56036eb3ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:06.567303 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-cc7ecaeb-7097-45a5-a9e7-a56036eb3ccc None None] MFA Rules not processed for user `8d914744ac8a4086830add2933d0582f`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:20:06.568519 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-cc7ecaeb-7097-45a5-a9e7-a56036eb3ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:20:06.638597 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1441/2882] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:20:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:20:06.653303 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd06c7-4477-4e25-9736-b88617b8d3d1 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:20:06.655042 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5abd06c7-4477-4e25-9736-b88617b8d3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:20:06.734549 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd06c7-4477-4e25-9736-b88617b8d3d1 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:20:06.740315 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a2c06-432a-498d-9e0f-d0dbac82facb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:20:06.740976 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a2c06-432a-498d-9e0f-d0dbac82facb service nova] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:06.741262 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a2c06-432a-498d-9e0f-d0dbac82facb service nova] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:06.741590 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a2c06-432a-498d-9e0f-d0dbac82facb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:06.808466 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a2c06-432a-498d-9e0f-d0dbac82facb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:20:06.810114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a2c06-432a-498d-9e0f-d0dbac82facb service nova] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:20:06.826508 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1442/2883] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:20:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:20:28.329665 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc62ff-4723-4483-828e-1b30ac4b8149 None None] REQUEST_METHOD: `POST` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:28.330197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc62ff-4723-4483-828e-1b30ac4b8149 None None] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:28.330197 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc62ff-4723-4483-828e-1b30ac4b8149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:28.347937 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.auth.core [None req-b4bc62ff-4723-4483-828e-1b30ac4b8149 None None] MFA Rules not processed for user `934f4b8dae3b410ebc6b8c03f47b15a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79871) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:20:28.349151 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-b4bc62ff-4723-4483-828e-1b30ac4b8149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:20:28.356068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1442/2884] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:20:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:20:28.665682 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a2c06-432a-498d-9e0f-d0dbac82facb service nova] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:20:28.667114 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-455a2c06-432a-498d-9e0f-d0dbac82facb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:20:28.722428 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a2c06-432a-498d-9e0f-d0dbac82facb service nova] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:20:28.726017 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5f740-255b-48a6-848b-49c9389ff353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:20:28.726656 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5f740-255b-48a6-848b-49c9389ff353 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:28.726941 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5f740-255b-48a6-848b-49c9389ff353 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:28.727220 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5f740-255b-48a6-848b-49c9389ff353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:28.729033 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a8e5f740-255b-48a6-848b-49c9389ff353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:20:28.739032 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5f740-255b-48a6-848b-49c9389ff353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:20:28.740501 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5f740-255b-48a6-848b-49c9389ff353 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:20:28.748383 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1443/2885] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:20:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:20:46.927405 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc62ff-4723-4483-828e-1b30ac4b8149 None None] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:20:46.937724 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc62ff-4723-4483-828e-1b30ac4b8149 None None] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:20:46.941336 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16972dee-804b-4689-9b86-7da32bb1d820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:20:46.941970 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16972dee-804b-4689-9b86-7da32bb1d820 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:20:46.942251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16972dee-804b-4689-9b86-7da32bb1d820 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:20:46.942525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16972dee-804b-4689-9b86-7da32bb1d820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:20:46.951451 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16972dee-804b-4689-9b86-7da32bb1d820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:20:46.953657 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16972dee-804b-4689-9b86-7da32bb1d820 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:20:46.962826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1443/2886] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:20:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:22:40.690669 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5f740-255b-48a6-848b-49c9389ff353 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:22:40.699164 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5f740-255b-48a6-848b-49c9389ff353 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:22:40.703058 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14d933-7cd0-4809-a79e-6cc9fa8981bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:22:40.703706 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d933-7cd0-4809-a79e-6cc9fa8981bb service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:22:40.703985 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d933-7cd0-4809-a79e-6cc9fa8981bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:22:40.704293 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d933-7cd0-4809-a79e-6cc9fa8981bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:22:40.706026 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-7b14d933-7cd0-4809-a79e-6cc9fa8981bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:22:40.715793 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14d933-7cd0-4809-a79e-6cc9fa8981bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:22:40.717238 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14d933-7cd0-4809-a79e-6cc9fa8981bb service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:22:40.725521 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1444/2887] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:23:02.577287 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16972dee-804b-4689-9b86-7da32bb1d820 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:23:02.586668 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16972dee-804b-4689-9b86-7da32bb1d820 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:23:02.590317 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c0d4d-2ebe-4491-b68e-ebd9fe54ab4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:23:02.590968 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c0d4d-2ebe-4491-b68e-ebd9fe54ab4d service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:23:02.591234 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c0d4d-2ebe-4491-b68e-ebd9fe54ab4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:23:02.591510 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c0d4d-2ebe-4491-b68e-ebd9fe54ab4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:23:02.593257 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-214c0d4d-2ebe-4491-b68e-ebd9fe54ab4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:23:02.626070 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c0d4d-2ebe-4491-b68e-ebd9fe54ab4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:23:02.627479 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c0d4d-2ebe-4491-b68e-ebd9fe54ab4d service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:23:02.647708 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1444/2888] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:23:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:23:03.834483 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14d933-7cd0-4809-a79e-6cc9fa8981bb service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:23:03.842871 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14d933-7cd0-4809-a79e-6cc9fa8981bb service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:23:03.847381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77afb3-30a2-46e6-8dfa-126ae85c90a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:23:03.848023 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77afb3-30a2-46e6-8dfa-126ae85c90a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:23:03.848349 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77afb3-30a2-46e6-8dfa-126ae85c90a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:23:03.848632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77afb3-30a2-46e6-8dfa-126ae85c90a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:23:03.850384 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-5d77afb3-30a2-46e6-8dfa-126ae85c90a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:23:03.864377 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77afb3-30a2-46e6-8dfa-126ae85c90a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:23:03.865807 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77afb3-30a2-46e6-8dfa-126ae85c90a8 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:23:03.876634 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1445/2889] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:23:05.139826 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c0d4d-2ebe-4491-b68e-ebd9fe54ab4d service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:23:05.155417 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c0d4d-2ebe-4491-b68e-ebd9fe54ab4d service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:23:05.163230 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba1c81-882b-48fc-b5ef-a947ce5589ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:23:05.163884 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1c81-882b-48fc-b5ef-a947ce5589ec service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:23:05.164204 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1c81-882b-48fc-b5ef-a947ce5589ec service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:23:05.164477 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1c81-882b-48fc-b5ef-a947ce5589ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:23:05.166527 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-51ba1c81-882b-48fc-b5ef-a947ce5589ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:23:05.179905 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba1c81-882b-48fc-b5ef-a947ce5589ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:23:05.181780 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba1c81-882b-48fc-b5ef-a947ce5589ec service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:23:05.194152 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1445/2890] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:23:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:23:06.139536 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71559da8-9c8a-4e3b-831b-60d85e54b0c6 None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:23:06.139987 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71559da8-9c8a-4e3b-831b-60d85e54b0c6 None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:23:06.140103 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71559da8-9c8a-4e3b-831b-60d85e54b0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:23:06.157901 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-71559da8-9c8a-4e3b-831b-60d85e54b0c6 None None] MFA Rules not processed for user `934f4b8dae3b410ebc6b8c03f47b15a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:23:06.159279 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-71559da8-9c8a-4e3b-831b-60d85e54b0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:23:06.166149 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1446/2891] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:23:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:23:06.479068 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba1c81-882b-48fc-b5ef-a947ce5589ec service nova] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:23:06.488861 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba1c81-882b-48fc-b5ef-a947ce5589ec service nova] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:23:06.492437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fad8f-d833-4365-a4ff-c20783fe4e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:23:06.493072 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fad8f-d833-4365-a4ff-c20783fe4e41 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:23:06.493351 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fad8f-d833-4365-a4ff-c20783fe4e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:23:06.493624 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fad8f-d833-4365-a4ff-c20783fe4e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:23:06.495348 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-004fad8f-d833-4365-a4ff-c20783fe4e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:23:06.504867 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fad8f-d833-4365-a4ff-c20783fe4e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:23:06.506267 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fad8f-d833-4365-a4ff-c20783fe4e41 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:23:06.513984 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1446/2892] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:23:06.960859 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71559da8-9c8a-4e3b-831b-60d85e54b0c6 None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:23:06.962986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-71559da8-9c8a-4e3b-831b-60d85e54b0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:23:07.036205 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71559da8-9c8a-4e3b-831b-60d85e54b0c6 None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:23:07.041098 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6669390-63a3-4d10-9f9d-81604726d299 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5222a62941948229324ec8c073caf86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:23:07.041743 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6669390-63a3-4d10-9f9d-81604726d299 service placement] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:23:07.042027 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6669390-63a3-4d10-9f9d-81604726d299 service placement] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:23:07.042306 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6669390-63a3-4d10-9f9d-81604726d299 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:23:07.044077 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a6669390-63a3-4d10-9f9d-81604726d299 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:23:07.055813 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6669390-63a3-4d10-9f9d-81604726d299 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:23:07.057417 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6669390-63a3-4d10-9f9d-81604726d299 service placement] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:23:07.067653 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1447/2893] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:23:20.235989 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fad8f-d833-4365-a4ff-c20783fe4e41 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:23:20.250158 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fad8f-d833-4365-a4ff-c20783fe4e41 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:23:20.256353 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccbdb6-49d2-4768-bdca-343d92ee1b14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:23:20.257001 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccbdb6-49d2-4768-bdca-343d92ee1b14 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:23:20.257280 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccbdb6-49d2-4768-bdca-343d92ee1b14 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:23:20.257555 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccbdb6-49d2-4768-bdca-343d92ee1b14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:23:20.259339 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-8fccbdb6-49d2-4768-bdca-343d92ee1b14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:23:20.272092 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccbdb6-49d2-4768-bdca-343d92ee1b14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:23:20.273697 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccbdb6-49d2-4768-bdca-343d92ee1b14 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:23:20.284525 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1447/2894] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:23:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:24:43.337209 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6669390-63a3-4d10-9f9d-81604726d299 service placement] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:24:43.338566 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-a6669390-63a3-4d10-9f9d-81604726d299 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:24:43.351541 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6669390-63a3-4d10-9f9d-81604726d299 service placement] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:24:43.356450 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df011859-9c55-4a5a-9962-77fcc6a8cc0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5222a62941948229324ec8c073caf86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:24:43.357076 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011859-9c55-4a5a-9962-77fcc6a8cc0c service placement] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:24:43.357358 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011859-9c55-4a5a-9962-77fcc6a8cc0c service placement] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:24:43.357631 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011859-9c55-4a5a-9962-77fcc6a8cc0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:24:43.359926 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-df011859-9c55-4a5a-9962-77fcc6a8cc0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:24:43.370912 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df011859-9c55-4a5a-9962-77fcc6a8cc0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:24:43.372496 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df011859-9c55-4a5a-9962-77fcc6a8cc0c service placement] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:24:43.382111 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1448/2895] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:25:15.497057 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccbdb6-49d2-4768-bdca-343d92ee1b14 service nova] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:25:15.499009 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-8fccbdb6-49d2-4768-bdca-343d92ee1b14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:25:15.553933 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccbdb6-49d2-4768-bdca-343d92ee1b14 service nova] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:25:15.557538 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a3fe0-f9b2-4fe3-9d88-7f99895239c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b14c0c2f0cd4459915dbbe3b5939159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:25:15.558171 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a3fe0-f9b2-4fe3-9d88-7f99895239c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:25:15.558448 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a3fe0-f9b2-4fe3-9d88-7f99895239c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:25:15.558721 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a3fe0-f9b2-4fe3-9d88-7f99895239c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:25:15.567484 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a3fe0-f9b2-4fe3-9d88-7f99895239c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:25:15.568964 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a3fe0-f9b2-4fe3-9d88-7f99895239c6 service cinder] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:25:15.578451 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1448/2896] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:25:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:25:26.522878 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528bd08-1695-48b5-9f7c-67f2ef0034fe None None] REQUEST_METHOD: `POST` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:25:26.523387 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528bd08-1695-48b5-9f7c-67f2ef0034fe None None] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:25:26.523493 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528bd08-1695-48b5-9f7c-67f2ef0034fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:25:26.542144 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.auth.core [None req-1528bd08-1695-48b5-9f7c-67f2ef0034fe None None] MFA Rules not processed for user `934f4b8dae3b410ebc6b8c03f47b15a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 12:25:26.543319 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-1528bd08-1695-48b5-9f7c-67f2ef0034fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:25:26.550116 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1449/2897] 10.222.0.58 () {58 vars in 957 bytes} [Tue May 17 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 12:25:50.362893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a3fe0-f9b2-4fe3-9d88-7f99895239c6 service cinder] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:25:50.372902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a3fe0-f9b2-4fe3-9d88-7f99895239c6 service cinder] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:25:50.377425 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e963ba-a7fb-4d97-906c-c5dba33da2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:25:50.378061 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e963ba-a7fb-4d97-906c-c5dba33da2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:25:50.378344 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e963ba-a7fb-4d97-906c-c5dba33da2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:25:50.378621 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e963ba-a7fb-4d97-906c-c5dba33da2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:25:50.387972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e963ba-a7fb-4d97-906c-c5dba33da2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:25:50.389441 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e963ba-a7fb-4d97-906c-c5dba33da2c8 service neutron] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:25:50.398902 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1449/2898] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:25:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:27:42.184717 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528bd08-1695-48b5-9f7c-67f2ef0034fe None None] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:27:42.194754 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528bd08-1695-48b5-9f7c-67f2ef0034fe None None] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:27:42.198765 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e905-dbaf-4f26-a195-4689257e4462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:27:42.199509 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e905-dbaf-4f26-a195-4689257e4462 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:27:42.200402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e905-dbaf-4f26-a195-4689257e4462 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:27:42.200736 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e905-dbaf-4f26-a195-4689257e4462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:27:42.209379 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967e905-dbaf-4f26-a195-4689257e4462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:27:42.210776 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967e905-dbaf-4f26-a195-4689257e4462 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:27:42.220848 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1450/2899] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:27:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:27:44.564632 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e963ba-a7fb-4d97-906c-c5dba33da2c8 service neutron] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:27:44.566077 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-20e963ba-a7fb-4d97-906c-c5dba33da2c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:27:44.583398 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e963ba-a7fb-4d97-906c-c5dba33da2c8 service neutron] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:27:44.589631 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34712ab-2b83-4cf1-96de-e9847a6c5e07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd86479ff40f54e7793f1771cb6ad362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:27:44.590423 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34712ab-2b83-4cf1-96de-e9847a6c5e07 service nova] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:27:44.590898 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34712ab-2b83-4cf1-96de-e9847a6c5e07 service nova] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:27:44.591214 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34712ab-2b83-4cf1-96de-e9847a6c5e07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:27:44.593273 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-a34712ab-2b83-4cf1-96de-e9847a6c5e07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:27:44.606029 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34712ab-2b83-4cf1-96de-e9847a6c5e07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:27:44.607856 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34712ab-2b83-4cf1-96de-e9847a6c5e07 service nova] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:27:44.618735 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1450/2900] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:27:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:27:54.543131 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e905-dbaf-4f26-a195-4689257e4462 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:27:54.552012 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e905-dbaf-4f26-a195-4689257e4462 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:27:54.555610 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98937d54-f294-4058-8832-c35b0db04645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95029e6140de425e86b5f9d7e2923bb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:27:54.556278 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937d54-f294-4058-8832-c35b0db04645 service neutron] REQUEST_METHOD: `GET` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:27:54.556562 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937d54-f294-4058-8832-c35b0db04645 service neutron] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:27:54.556837 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937d54-f294-4058-8832-c35b0db04645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:27:54.616003 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98937d54-f294-4058-8832-c35b0db04645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:27:54.617391 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98937d54-f294-4058-8832-c35b0db04645 service neutron] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:27:54.627249 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1451/2901] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 12:28:00.262583 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34712ab-2b83-4cf1-96de-e9847a6c5e07 service nova] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:28:00.270307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34712ab-2b83-4cf1-96de-e9847a6c5e07 service nova] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:28:00.275558 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:28:00.276630 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:28:00.276972 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:28:00.277255 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] PATH_INFO: `/v3/users/934f4b8dae3b410ebc6b8c03f47b15a7` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:28:00.278961 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] RBAC: Authorizing `identity:delete_user(user_id=934f4b8dae3b410ebc6b8c03f47b15a7)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:28:00.280983 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:28:00.326808 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934f4b8dae3b410ebc6b8c03f47b15a7'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.333893 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934f4b8dae3b410ebc6b8c03f47b15a7'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.341768 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934f4b8dae3b410ebc6b8c03f47b15a7'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.342801 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934f4b8dae3b410ebc6b8c03f47b15a7'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.343437 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934f4b8dae3b410ebc6b8c03f47b15a7'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.360954 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1451/2902] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:28:00 2022] DELETE /identity/v3/users/934f4b8dae3b410ebc6b8c03f47b15a7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:28:00.534632 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98937d54-f294-4058-8832-c35b0db04645 service neutron] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:28:00.546639 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98937d54-f294-4058-8832-c35b0db04645 service neutron] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:28:00.602535 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:28:00.603381 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:28:00.603664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:28:00.603939 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] PATH_INFO: `/v3/projects/96b18ec30b804e1e9ac7467a441c919b` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:28:00.605136 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b18ec30b804e1e9ac7467a441c919b)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:28:00.607768 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:28:00.652117 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b18ec30b804e1e9ac7467a441c919b', 'request_id': 'req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.658664 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b18ec30b804e1e9ac7467a441c919b', 'request_id': 'req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.663916 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b18ec30b804e1e9ac7467a441c919b', 'request_id': 'req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.675886 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] The token cache is being invalidate because project 96b18ec30b804e1e9ac7467a441c919b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:28:00.676196 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.676897 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.678425 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1452/2903] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:28:00 2022] DELETE /identity/v3/projects/96b18ec30b804e1e9ac7467a441c919b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:28:00.682373 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:28:00.683823 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:28:00.697505 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075f75-9a41-4644-bf32-bdc97937341f admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:28:00.753798 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:28:00.754659 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:28:00.754935 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:28:00.755205 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] PATH_INFO: `/v3/users/8d914744ac8a4086830add2933d0582f` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:28:00.756404 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d914744ac8a4086830add2933d0582f)` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:28:00.758307 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:28:00.802285 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d914744ac8a4086830add2933d0582f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.809037 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d914744ac8a4086830add2933d0582f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.819939 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d914744ac8a4086830add2933d0582f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.820704 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d914744ac8a4086830add2933d0582f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.821520 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.notifications [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d914744ac8a4086830add2933d0582f'} {{(pid=79871) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:00.841251 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1452/2904] 10.222.0.58 () {58 vars in 1223 bytes} [Tue May 17 12:28:00 2022] DELETE /identity/v3/users/8d914744ac8a4086830add2933d0582f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:28:01.015266 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] Authenticating user token {{(pid=79870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:28:01.016711 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.fernet_utils [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:28:01.032321 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bc211-fec4-4c9f-907f-5dd6e8e60ec7 admin admin] Validating token access rules against request {{(pid=79870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:28:01.093034 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ae019bc4584bc39f9f7fb0d0af90e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2acfce5cbf9f4de7bfe02428af601440', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:28:01.093896 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:28:01.094189 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:28:01.094835 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] PATH_INFO: `/v3/projects/ce259642aa1048e59412b157eae009fa` {{(pid=79870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:28:01.096037 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce259642aa1048e59412b157eae009fa)` {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:28:01.097986 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] RBAC: Authorization granted {{(pid=79870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:28:01.149402 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce259642aa1048e59412b157eae009fa', 'request_id': 'req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:01.155865 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce259642aa1048e59412b157eae009fa', 'request_id': 'req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:01.161915 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce259642aa1048e59412b157eae009fa', 'request_id': 'req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2'} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:01.175372 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] The token cache is being invalidate because project ce259642aa1048e59412b157eae009fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 12:28:01.175832 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:01.176591 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: DEBUG keystone.notifications [None req-af3bf7fc-aaac-4166-b32f-3ca84d4c66c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 12:28:01.178367 dv-cinder-837699-7-iscsi devstack@keystone.service[79870]: [pid: 79870|app: 0|req: 1453/2905] 10.222.0.58 () {58 vars in 1232 bytes} [Tue May 17 12:28:01 2022] DELETE /identity/v3/projects/ce259642aa1048e59412b157eae009fa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 12:29:49.330428 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] Authenticating user token {{(pid=79871) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 12:29:49.331828 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:29:49.467156 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c99b8-270b-4505-a8da-78a1bb250d99 admin admin] Validating token access rules against request {{(pid=79871) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 12:29:49.522683 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb6422-1617-4e2b-99b3-ca8d8a90f2a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5222a62941948229324ec8c073caf86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c3eefc2606b4ee988e14ac7e11f90ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79871) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 12:29:49.523338 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb6422-1617-4e2b-99b3-ca8d8a90f2a4 service placement] REQUEST_METHOD: `GET` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 12:29:49.523625 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb6422-1617-4e2b-99b3-ca8d8a90f2a4 service placement] SCRIPT_NAME: `/identity` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 12:29:49.523906 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb6422-1617-4e2b-99b3-ca8d8a90f2a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79871) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 12:29:49.525729 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.fernet_utils [None req-51eb6422-1617-4e2b-99b3-ca8d8a90f2a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79871) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 12:29:49.537857 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb6422-1617-4e2b-99b3-ca8d8a90f2a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 12:29:49.539451 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb6422-1617-4e2b-99b3-ca8d8a90f2a4 service placement] RBAC: Authorization granted {{(pid=79871) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 12:29:49.549845 dv-cinder-837699-7-iscsi devstack@keystone.service[79871]: [pid: 79871|app: 0|req: 1453/2906] 10.222.0.58 () {60 vars in 1365 bytes} [Tue May 17 12:29:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)